edms critical functionality report - final · pdf file2006-05-19 · a-3 activity...
TRANSCRIPT
EDMS CRITICAL FUNCTIONALITY REPORT - FINAL
Prepared for:
Western Governors’ Association Western Regional Air Partnership
1515 Cleveland Place, Suite 200 Denver, CO 80202
Contract #30204-115
Prepared by:
and
Air Sciences Inc. 1301 Washington Avenue
Suite 200 Golden, CO 80401
March 14, 2007
Table of Contents Section Page
Executive Summary 1 1 Background 3 2 EDMS Requirements 3 3 General Analysis 3 3.1 Database Design 4 3.2 Database Content 5 3.3 Web Site Design 7 3.4 Application Code Design 8 3.5 Process and Data Flows 8 3.5.1 Data Submittal 8 3.5.2 Data Reporting Processes 10 4 EDMS Critical Functionality Analysis 11 4.1 Methods 11 4.2 Issues, Recommended Solutions, and Action Plan 12 5 Recommended Future Enhancements 15 5.1 Link the EDMS to the TSS 15 5.2 Host the EDMS at CIRA 16 Appendix A A-1
List of Figures Figure Page A-1 Database Schemas A-8 A-2 Area Emission Source Tables from the Pechan Data Model A-10 A-3 Activity Detail from the Pechan Data Model A-11 A-4 Inventory Tables from the Pechan Data Model A-12 A-5 Logging Tables from the Pechan Data Model A-13
i
List of Figures (continued) Figure Page A-6 Security Tables from the Pechan Data Model A-14 A-7 Automated Data Submittal Process A-26 A-8 Report Generation A-30
List of Tables Table Page
3-1 The Production Tables 7
3-2 The EDMS Upload Program 9 3-3 Assumed DBA Data Submittal Steps 9 3-4 On-Screen Displays and Export File Types 11 4-1 Critical and Major Issues 13 4-2 Minor and Trivial Issues 14 4-3 Other Action Items 15 A-1 EDMS Transition Requirements A-2 A-2 EDMS Requirements A-4 A-3 Inventory Version Description A-15 A-4 Older Inventory Checklist (Point Source Emissions) A-18 A-5 Older Inventory Checklist (Area Source Emissions) A-19 A-6 Older Inventory Checklist (Biogenics) A-20 A-7 Older Inventory Checklist (On-Road Mobile Emissions) A-20
ii
List of Tables (continued) Table Page A-8 Older Inventory Checklist (Non-Road Mobile Emissions) A-21 A-9 Inventory 9 Checklist (Point Source Emissions) Production Tables A-22 A-10 Inventory 9 Checklist (Area Source Emissions) Production Tables A-23 A-11 Inventory 9 Checklist (Biogenics) Production Tables A-24 A-12 Inventory 9 Checklist (On-Road Mobile Emissions) Production Tables A-24 A-13 Inventory 9 Checklist (Non-Road Mobile Emissions) Production Tables A-25
iii
Executive Summary Air Resource Specialists, Inc. (ARS), teaming with Air Sciences Inc., was awarded Contract #30204-115, effective November 6, 2006, for the WRAP EDMS Operations and Maintenance Project. Under this contract, ARS and Air Sciences will provide database and web site hosting, software fixes and enhancements, emissions data quality assurance and handling, and other miscellaneous consulting services through calendar year 2007. This Critical Functionality Report is a required deliverable of this contract (Task B). It contains a detailed overview of the team’s review of the Emissions Data Management System (EDMS) requirements, database/web interface structure and functionality, database content, recommended future enhancements, and a prioritized 2007 action plan. The EDMS is designed to be a warehouse of emissions data accessible to WRAP states and tribes via the Internet. Its major user-accessible features include: graphical and tabular predefined reports, an ad hoc reporting function, a mapping component, and the ability to upload data. Each of these features, except the data upload capability, was found to meet at least the minimum system requirements. However, the underlying database and web interface software, while generally functional, were found to have critical flaws that affect system performance, data quality, general user value, and system maintenance and enhancement. This report identifies these problems and recommends specific solutions. During the transfer of EDMS responsibilities from E.H. Pechan to ARS, multiple versions of code (not well-identified) were provided, but virtually no system level documentation. Therefore, the method used to gain an operational understanding of the EDMS has been a discovery process. Tables 4-1 and 4-2 present a detailed summary of all problems found, recommended solutions, and anticipated timing to complete. Table 4-3 presents other action items that are expected to occur in 2007. General findings and recommendations (with report section references) include:
• The critical functionality review began with an assessment of the EDMS requirements, as defined in various project documents prepared prior to ARS’ involvement. (Section 2)
• Overall, the EDMS was found to function at a minimally satisfactorily level as an emissions inventory data warehouse and web application to support emissions tracking for the WRAP. Users are able, for the most part, to navigate the web interface and retrieve the data they need. However, the EDMS database, as it currently exists, requires internal restructuring. (Section 3)
• The database was poorly designed, does not conform to standard practices, is missing some critical features and contains other extraneous features. It does not take full advantage of the inherent power and functionality of Oracle. Numerous restructuring and clean-up tasks are recommended. (Section 3.1)
• There are numerous distinct inventories currently loaded in the database and available to users. It is recommended that obsolete and training inventories be removed from the database. (Section 3.2)
1
• Some revisions exist for inventory 9, and inventory 10 is not in the production database. Identified revisions for inventory 9 should be added to the database, and inventory 10 should be QA’d and made available. (Section 3.2)
• In general the web site design is acceptable. It is relatively easy for a user to register and to navigate the site once activated. Only minor recommendations to enhance user experience are offered. (Section 3.3)
• The application code design is poor and does not conform to standard practices. It should be largely re-written to ensure reliability, scalability and maintainability. (Section 3.4)
• The data submittal process is extremely convoluted and only semi-functional. It is recommended that the entire process be revised and thoroughly documented. (Section 3.5)
• Potential future enhancements for the EDMS were identified and reviewed. The recommended methods for improving EDMS data review and analysis functionality are discussed largely in terms of a cost effective and straight forward linkage between the EDMS and the WRAP Technical Support System (TSS). The TSS is currently under development and will soon be capable of storing, analyzing, and presenting emissions data. (Section 5)
2
1 Background This Critical Functionality Report contains a detailed overview of a review of the Emissions Data Management System (EDMS) requirements, database/web interface structure and functionality, database content, recommended future enhancements, and a prioritized 2007 action plan. For the transfer of the EDMS database and web application from the University of Northern Carolina host site to the host site at ARS, the ARS team hoped to work with Pechan staff to make a smooth transition. However, Pechan was unable to provide a single, efficient transfer of the application in its entirety. Instead, the application was provided piecemeal, with ARS discovering through trial and error that pieces were missing and Pechan providing several versions of source code with little indication of the code’s status. Again, ARS was forced to employ a trial and error process in order to provide the EDMS at our host site with the highest amount of functionality possible. Table A-1 of the Appendix presents a summary list of EDMS components involved in the transition.
2 EDMS Requirements Many documents from the EDMS Project Web maintained by Pechan were reviewed in
an attempt to glean the system requirements. The following documents provided most of the requirements details for this report:
1. “Emissions Data Management System Design As Delivered Final Report” prepared
by E.H. Pechan, August 2006. 2. “EDMS Scope of Work Draft 3” prepared by E.H. Pechan, date unknown.
3. “Final Needs Assessment For Evaluation And Design Of An Emissions Data Reporting, Management, And Tracking System” prepared by EA Engineering, Science, and Technology, July 2003.
The collective requirements from these documents have been assembled in Table A-2 of
Appendix A. The requirements are categorized and the source documents noted as numbered above. The remarks column provides a brief assessment of the system’s ability to meet the requirement.
3 General Analysis Overall, the EDMS is a functioning emissions inventory data warehouse and web application that generally meets the application goal of providing regional emissions tracking for the WRAP. Users are able, for the most part, to navigate the web interface and retrieve the data they need. Internally, however, the EDMS is currently a jumble of database objects, Visual Basic code, Active Server Pages, and Javascript. Numerous empty and otherwise seemingly pointless
3
database objects exist, thousands of lines of code have been commented out and replaced with no indication of why, and hundreds of stored procedures exist where only a fraction are truly needed to do the work. This section discusses these types of specific design issues and provides recommended solutions. A section discussing the database content and steps taken to verify the validity of the content is also included.
3.1 Database Design The database was designed to accommodate the import and export of NIF formatted data and appears to be based on the NEI Staging Database Process developed by Pechan for the NEI. This process requires the data to pass through three QA/QC “stages” before moving to the final stage, the production tables. The stages are managed by individual schemas within the database. An Oracle schema is a collection of database objects owned by a database user and having the same name as that user (in this case, the database “users” are processes and not people). These users/schemas are named EDMS_TXR, EDMS_TXN, EDMS_STG and EDMS_PRD (the production tables). Additional schemas exist to house the web interface related database objects (such as the registered EDMS users, documents available for download, text that appears on certain web pages, etc.), a set of “lookup” tables (such as county, state, and tribal fips codes), and audit data for each stage. In addition to the emissions source tables, the EDMS_PRD schema contains a set of pre-generated summary tables that provide data to the user through the web interface. The only time data are retrieved directly from the production emission source tables is when the user has requested a NIF export file. The database schemas and their tables are presented in Figure A-1 of Appendix A.
At least 100 of the database tables contain no data, including the audit tables. Another 30 or so tables appear to be “temporary,” “test,” or “backup” tables as indicated by their names. Several sample database schemas and hundreds of their objects also exist. There are hundreds of indexes and views with no apparent purpose. Tables in the staging schemas (EDMS_TXR, EDMS_TXN, EDMS_STG), which should be empty according to Pechan’s close-out document, do contain a variety of data including data for Inventory 10.
According to Pechan’s documentation, “…fields specific to the EDMS data management
are appended to the existing NIF data management schema. These fields contain only keys, version indicators, and pointers to other data structures.” Unfortunately, the keys are contrived and the pointers are non-existent. Instead of using standard database techniques of creating primary keys, a sequence, insert trigger and update trigger exists for virtually every table. This technique is equivalent to applying the Autonumber data type to a table field in MS-Access and making it the primary key. It is an acceptable database tuning technique only if a unique composite index is also created for the table to prevent duplicate rows from occurring. No such unique indexes exist.
Absolutely no foreign key constraints that enforce the relational rules among tables exist.
Null constraints that prevent null values from occurring and check constraints to prevent out of range data from being inserted into a table are also virtually non-existent. Instead, a multitude of stored procedures exist to test submitted data to ensure it conforms to the rules. However, attempts to apply a couple of unique and foreign key constraints where they should be and a
4
quick check of production table data against just a few of the rules stated in the QA/QC document indicate that numerous rules are broken by data in the production tables. Some data in the EDMS production tables do not conform to the QA/QC requirements. Some of these problems are further illustrated in Figures A-2 through A-6 in the Appendix.
Other less critical problems also exist such as misspellings in table names (for example,
table names intended to contain the word “criteria” spelled “cretaria”) and inconsistent data types (dates sometimes stored as character data instead of date data).
Initial recommended solutions for the database include: • Removing sample and other nonessential tables and other objects.
• Applying primary key/unique, foreign key, and other constraints based on basic database design standards and QA/QC requirements to the production tables, resolving issues with the data that do not conform.
• Implementing additional changes based on re-evaluating the database audit requirements (possibly removing the audit schemas and objects and using the built-in Oracle audit capabilities).
• Implementing additional changes based on revision of the data submittal and QA/QC processes.
• Continuing to fully document the structure, purpose and relationships of all essential database objects.
3.2 Database Content Methods used to verify database content by inventory and the results found are discussed
in this section followed by an assessment of the production tables. The actual summaries are provided in Tables A-3 through A-13 of Appendix A. Early Inventory Versions
Data from older Inventories (1-7) included on the website were not reviewed for accuracy as there are no readily available external data sets for comparison. A description and summary of earlier datasets can be found in Tables A-4 through A-8 in Appendix A. Inventory 5 has been used for training purposes and should not be available to the data user as it contains erroneous data. Inventory 8 – Actual Version 1.2
No discrepancies were found when comparing Inventory 8 data from the Pechan Inventory Description files and data from the development and production databases. Inventory 9 – 2002 Final V-2.0
The following procedures were used in testing the accuracy of Inventory 9 data:
1. Data from the following sources were imported into an MS Access database: • Data exported using the standard reports on website
5
• Data on the website from the “snapshot file” • Inventory Description files from Pechan • Data exported from the development database • Data exported from the production database
2. Data for each emissions source type, from each source listed above, were compared
by state/tribe and pollutant for agreement. Data exported from the website and the snapshot files were found to be unreliable and outdated. Data from the development and production databases were identical. Therefore, comparisons focused on Inventory 9 description files from Pechan and data from the production database.
3. The Pechan Inventory Description files contain worksheets listing state/tribal totals
and worksheets with “revised” data. In cases where revised data were available, those were also compared to the production table data for accuracy.
The following assumptions were made for data to be deemed correct and complete for
Inventory 9:
1. State/Tribal totals reflect correct County totals (tons per year). 2. Inventory Description files from Pechan are correct.
• IDD_Inv9_point.xls • IDD_Inv9_area.xls • IDD_Inv9_mobile.xls • IDD_Inv9_offroad.xls • IDD_Inv9_Biogenics.xls
3. Values within 5 tons per year were considered correct, due to variation in rounding
and/or addition. A summary of Inventory 9 can be found in Tables A-9 through A-13 in the Appendix. Inventory 10 – 2018 and Additional 2002 Tribal Data for Inventory 9 Pechan’s closeout document states “[B]ecause of database disk space constraints, the data loads of the 2018 (Inventory 10) and the additional 2002 Tribal data for Inventory 9 that were received by Pechan after Inventory 9 was deemed complete were loaded onto the development/test database. The production application was modified to “look” into the development/test database for these data.” However, the Oracle export file received from Pechan claiming to contain the development/test database is identical to the emission source tables in the production database. Instead, some, but not all, of these data are found in the EDMS_TXN emission source tables. Since the soundness of the data submittal and QA/QC process is suspect (discussed in various other areas of this report) and the status of these data are undocumented, our recommendation is to delete these data from the EDMS_TXN tables and reload them once the data submittal QA/QC has been revised.
6
The Production Tables (EDMS_PRD schema) Table 3-1 broadly summarizes the content of the emissions source tables in the production schema. The last update date was determined by querying the latest created/modified date field in each table.
Table 3-1. The Production Tables
Table Description Row count Last update TR Transmittal table includes the transmittal
information for the other sets of tables 15,025 5/19/2006
AREA_EP Area Emission Process 105,0943 1/31/2006 AREA_PE Area Emission Period 1,122,247 1/31/2006 AREA_EM Area Emission 9,790,998 1/30/2006 AREA_CE Area Emission Control Equipment 911,860 1/31/2006 BIOGENIC_EM Biogenic Emission 34,580 1/24/2006 ONROAD_PE Onroad Emission Period 1,614,018 12/21/2005 ONROAD_EM Onroad Emission 9,931,914 1/30/2006 POINT_SI Point Site 200,209 10/31/2006 POINT_EU Point Emission Unit 950,209 11/20/2005 POINT_ER Point Emission Release Point 810,252 12/3/2005 POINT_EP Point Emission Process 1,196,412 10/31/2006 POINT_PE Point Emission Period 1,199,416 11/28/2005 POINT_EM Point Emission 3,907,207 11/28/2005 POINT_CE Point Control Equipment 766,461 11/28/2005 As mentioned above in Section 3.1, most EDMS web site data queries are filled by retrieving data from pre-generated tables that summarize the data found in the emission source tables (AREA_EM, BIOGENIC_EM, ONROAD_EM, and POINT_EM). The apparent method for creating these tables is the use of an Oracle data warehousing feature called Materialized Views. Regular views in a database create a “view” of data from one or more tables “on-the-fly” whenever they are accessed. A materialized view physically stores the resulting data from a view definition as a table. Since the result set already exists, queries on a materialized view are returned to the user much faster than a regular view. Of course, when data in one or more of the base tables that a materialized view is based on are updated, the materialized view becomes stale and must be regenerated. It appears from inspecting the code to create these materialized views that Pechan intended to use a method to automatically regenerate stale materialized views.
It is not possible to determine when the materialized views were last generated because their creation date is the date when imported into the database created at ARS. However, manual generation of just two of these views returns a different row count then what exists in the current materialized view. Data from some reports based on these views are also sometimes inconsistent when compared to other sources. It is therefore assumed that the materialized views are stale and need to be regenerated. Initial regeneration of the materialized views and evaluation of the best method for maintaining fresh views are included in the Action Plan.
3.3 Web Site Design In general the web site design is acceptable. It is relatively easy for a user to register and to
navigate the site once activated. It does not comply with section 508 requirements but according
7
to Pechan documentation an agreement was met with the WRAP to resolve this issue through additional text under the Terms and Agreements link. Users accessing the site with the Foxfire browser are not able to log in. Although specific use of Foxfire is not listed as a requirement, we are aware that many users prefer this browser and have therefore identified it as an issue to resolve if practicable. This, along with other specific web site issues, is noted in the issues tables in Section 4.
3.4 Application Code Design Virtually nothing good can be said about the application code design. First, a brand new
application developed in 2004 should have been built on a newer technology platform than ASP and Visual Basic 6; at the least, Microsoft’s .NET platform. No discernable design standards have been followed; the code is full of redundancy, there are thousands of lines of commented out code with no explanation and excessive database connects/disconnects/reconnects, and a lack of even common sense logic in many cases.
Assuming it is not economically feasible to rewrite the entire web site application, we
recommend the following steps to repair the application code: • Identify the components (ASP files, Javascript files, Visual basic modules, etc.) that
are actually being used then remove and archive all extraneous components.
• Delete commented out code segments unless some potential useful purpose can be identified for the segment.
• Go through the code to apply standard formatting (indents, uppercase vs. lowercase text, etc.) and internally document the purpose of each file, module, procedure, and function.
• Apply automated documentation tools to find unused/undefined variables, code segments, etc.
• Test each step on the test instance of the web site
• Eventually implement repaired code on the production web site
3.5 Process and Data Flows EDMS processes fall under two broad categories: data submittal and data reporting. The data submittal process is extremely convoluted and only semi-functional. The reporting processes generally work as designed, although there are some problems, and, again, the underlying program code is extremely convoluted and does not conform to standard programming conventions. A summary of the data submittal process and of how the data are delivered through the reporting processes is presented in the following sections. More detail on both types of processes is provided in Appendix A.
3.5.1 Data Submittal Data are submitted to the system by users classified as Data Owners and by system
administrators via a web interface. This interface simply allows the user to specify an inventory version and sector type (Area, Point, Non-road Mobile, Fire, or On-road Mobile) and then to upload and submit a zip file. It then alerts the system administrator via an email message that a
8
file has been uploaded for processing. The system administrator processes the file by running a Visual Basic program called EDMSUPLOAD. This program executes the processes listed in Table 3-2. Comments on the processes are also provided.
Table 3-2. The EDMS Upload Program
Step Process Comments 1 Unzips the upload file and verifies that it
contains the standard NIF tables for the source in Microsoft Access (MDB) format.
(Although the requirements state the EDMS is to accept NIF data in text, Microsoft Excel, and XML format the system is currently not capable of doing so. Also, the program does not see Fire as a valid type, even though the user can select it.).
2 Reads the data from the MDB file and inserts rows into the associated emission source Oracle tables in the EDMS_TXR schema.
This step is superfluous
3 Immediately copies the data to the same emission source tables in the EDMS_TXN schema.
Executes a series of Oracle stored procedures (program code stored in the database) which perform quality control checks on the submitted data.
Nearly 500 stored procedures exist. Many can be replaced by leveraging the power of the Oracle database engine and applying table-level constraints and utilizing dynamic SQL coding techniques.
4
The quality control checks are logged and bad data rows are flagged.
Bad data rows are flagged by inserting an error statement in a log bearing a unique log id. The offending data rows are updated with the log id. After all checks have been done, rows that break more than one rule are flagged only with the last error found. This is likely the reason rule-breaking rows are found in the production tables.
At this point, the EDMSUPLOAD program ends thereby breaking the process “thread”.
We can only assume from reviewing the high-level Pechan documentation and the remaining stored procedures that the steps listed in Table 3-3 were taken next.
Table 3-3. Assumed DBA Data Submittal Steps
Step Process Comments 1 The DBA reviews flagged rows and either
fixes the erroneous data or further flags the row by entering an “I” in the disposition_status field.
No VB or stored procedure code has been found that provides a comprehensive list of errors and offending rows for the DBA to review.
2 The DBA executes stored procedures that select the data rows where the submittal_flag = ‘A’ and disposition_status field is not equal “I” from the EDMS_TXN schema set of tables and inserts them into the EDMS_STG set of tables.
Example procedure name: EDMS_STG.PROC_ETL_TXNTOSTG_AREA
3 A series of stored procedures are executed that update the data in the EDMS_STG tables
See Figure A-7, page A-29 in the Appendix. Although these procedures exist, the log file does not contain the logging information they are supposed to generate.
9
Other items of note regarding the existing submittal processes include:
• The EDMS_STG schema also contains a set of stored procedures that process data where the submittal flag contains values other than ‘A’. However, since the ETL_TXNTOSTG procedures only copies data rows from the EDMS_TXN to EDMS_STG schema where the submittal flag is ‘A’ or null, it is not clear if these procedures were ever executed. Again, no logging information supposedly generated by these procedures exists.
• It is not clear how data were intended to be moved from the EDMS_STG schema to the EDMS_PRD schema. No stored procedures exist to accomplish the move.
• None of the data transfer procedures delete data from the tables of the previous stage.
• No useful report products have been found that provide listings of errors detected by the QA/QC procedures.
These procedures are also documented in flow chart Figure A-7 in Appendix A. Due to the convoluted nature and mistakes in logic of the data submittal processes, we recommend reviewing, revising, and thoroughly documenting the process.
3.5.2 Data Reporting Processes Data are reported to the user in a variety of on-screen displays and export file types as
described in Table 3-4. The reporting process is presented as a flow chart as Figure A-8 in Appendix A. All data reporting functions follow the same general process:
1. The user makes a selection through the web interface which is generated by Active
Server Pages (ASP) files. The user may choose to set the criteria for the report by simple metrics (ie. State, county, scc code etc) or spatially through the use of the mapping interface. The mapping section of the web interface utilizes the Adobe Scalable Vector Graphics (SVG) Viewer which is embedded in the ASP page and accepts input from the user and displays data to the user.
2. Scripts embedded in the ASP call a program section in a compiled Visual Basic (VB) code library residing on the web server.
3. The VB program connects to the Oracle database, retrieves the data and either generates a file for export or returns the data to the ASP page for display.
4. The ASP page either presents a link for the user to download the file or displays the data on screen. For large export files, the export is scheduled to occur at a later time and the user is notified via email when the export is complete.
Most of the data reporting processes do not retrieve data directly from the emission
source tables in the production schema named EDMS_PRD. Instead, data are retrieved from pre-generated summary tables residing in the database or pre-generated, zipped, comma-delimited files residing on the web server. Only the NIF file export, available through the ad hoc query interface, generates export files based on direct queries to the EDMS_PRD emission source tables.
10
Table 3-4. On-Screen Displays and Export File Types
Report type On-screen display options
Download options
Standard reports GIS interface, graphs, tables
JPG or PDF images of charts, Excel or space-delimited text files
“Snapshot” files None Pre-generated zip files containing comma delimited text files
SMOKE Modeling files None Zip files containing space delimited text files with data based on the user’s query
Adhoc query files None Zip files containing both an MDB file and a space delimited text file with data based on the user’s query
4 EDMS Critical Functionality Analysis Comprehending how the EDMS was designed to function is essential in order to
accurately evaluate the effort required to fix issues. It is also essential to understand the data flows and process flows in order to implement fixes and enhancements without adversely affecting other functions within the system. Therefore, system testing was combined with system exploration and documentation to best evaluate EDMS issues. The following subsections discuss the steps taken and the methods used to perform the analysis.
4.1 Methods Virtually no system level documentation was provided. Therefore, the method used to
gain an operational understanding of the EDMS has been (and continues to be) a discovery process consisting of the following tasks:
• Tracing application code execution (we attempted to use a couple of commercial
software tools designed to automate application code documentation but the tools did not work well due to the lack of conventional standards within the Pechan code set)
• Inspecting log files
• Issuing database queries to determine database contents
• Reviewing the high-level documentation provided for clues to intended specific function
• Reviewing NEI documentation
• Generating process and data flow charts The test procedures used were designed primarily to identify critical problems within the
system. However, the tests and inspection of source code and database structures also measure the system's value to end-users by evaluating its usefulness and usability and the system’s
11
reliability, scalability (the capacity for a system to accommodate additional data and new types of data) and maintainability.
Testing results of EDMS functionality covers three areas:
1. Identification of issues with the existing web interface
2. Identification of issues with the existing data submittal process including QA/QC procedures
3. Identification of missing functionality based on the system requirements All functions have been tested to the extent possible within the time available. Some issues have been identified through program source code inspection rather than testing and have been discussed in the previous sections of this report. The report prepared by ERG titled “WRAP Emissions Data Management System (EDMS) Post-Beta Test Approach, Findings, and Recommendations” has also served as a resource to identify issues.
Each issue identified has been assigned a severity level based on expanded Bugzilla
definitions of how a bug affects an application: .
Severity Level Bugzilla definition / Expanded definition
Critical Crashes, loss of data, severe memory leak / Incorrectly reported data
Major Major loss of function / major loss of value to the user
Minor Minor loss of function, or other problem where an easy workaround is present / minor loss of value to the user
Trivial Cosmetic problem like misspelled words or misaligned text / or ugly images
4.2 Issues, Recommended Solutions, and Action Plan The section provides lists of the identified issues and recommended solutions and presents
a timeline for implementing the solutions. Three tables are provided. Table 4-1 lists the issues classified as Critical and Major because both greatly impact the overall value of the system. Critical and Major issues have been identified in all areas of functionality; data, data submittal, reporting, etc. The majority of these issues lie within the data itself and the data submittal process. A projected timeline for implementing a solution for each issue in this table is provided.
Table 4-2 presents a list of issues classified as minor and trivial. These also span the areas
of functionality. A projected timeline for implementing a solution has been provided for relatively easy to fix issues, others are listed “as feasible” and will be addressed as resources allow. The final table, Table 4-3, presents other actions, such as training, that are to take place during 2007.
12
Tabl
e 4-
1. C
ritic
al a
nd M
ajor
Issu
es
A
rea
Func
tion
Prob
lem
(s)
Seve
rity
L
evel
So
lutio
ns/ A
ltern
ate
solu
tion
Tim
elin
e
Dat
a
Mis
sing
and
revi
sed
stat
e an
d tri
be d
ata
sets
ar
e no
t inc
lude
d in
Inve
ntor
y 9
and
Inve
ntor
y 10
dat
a ar
e no
t in
the
prod
uctio
n ta
bles
; fire
dat
a is
not
cor
rect
ly in
clud
ed in
th
e da
taba
se.
Crit
ical
Lo
ad d
ata
into
the
prod
uctio
n da
taba
se.
Apr
il
Dat
abas
e
All
obje
cts
See
Sect
ion
3.1.
M
ajor
C
lean
up a
nd re
pair
(see
sect
ion
3.1)
. O
ngoi
ng
Initi
al Q
A p
roce
ss
TXN
_MA
STER
DIA
G
In te
stin
g, a
fata
l err
or is
retu
rned
. See
Se
ctio
n 3.
5.1.
C
ritic
al
Rev
iew
, rev
ise,
and
thor
ough
ly d
ocum
ent
QA
/QC
pro
cess
es. S
ee S
ectio
n 3.
5.1.
M
arch
Dat
a su
bmitt
al in
NIF
X
ML
form
at
Func
tiona
lity
is m
issi
ng. S
ome
sour
ce c
ode
was
pro
vide
d th
at in
dica
tes a
n in
tent
to
conv
ert X
ML
form
atte
d da
ta to
MD
B.
Crit
ical
D
evel
op a
pro
cedu
re to
read
the
XM
L da
ta
dire
ctly
into
the
Ora
cle
tabl
es.
Apr
il
Dat
a su
bmitt
al in
NIF
Ex
cel,
Text
form
at
Func
tiona
lity
is m
issi
ng.
Maj
or
Dro
p th
e re
quire
men
t if t
here
’s n
o ne
ed fo
r it.
Rec
eive
Act
ivity
Dat
a Fu
nctio
nalit
y is
mis
sing
. M
ajor
D
rop
the
requ
irem
ent.
Ther
e ar
e no
rela
ted
outp
ut re
quire
men
ts fo
r Act
ivity
dat
a.
Dat
a Su
bmitt
al
Subm
it da
ta in
vent
ory
sele
ctio
n U
sers
can
sele
ct a
ny in
vent
ory
vers
ion
to
subm
it da
ta to
. M
ajor
C
lear
ly d
efin
e in
vent
ory
vers
ions
and
w
hen
user
s are
allo
wed
to su
bmit
data
for
them
.
Mar
ch
App
licat
ion
Cod
e A
ll Se
e Se
ctio
n 3.
4.
Maj
or
Cle
anup
and
repa
ir (s
ee se
ctio
n 3.
4).
Ong
oing
Gen
eral
dat
a ou
tput
N
o ag
reem
ent b
etw
een
data
repo
rted
on
scre
en, d
ata
in E
xcel
exp
ort f
ile a
nd d
ata
“sna
psho
t file
”
Crit
ical
R
egen
erat
e su
mm
ary
tabl
es a
nd sn
apsh
ot
files
. Ver
ify su
mm
ary
tabl
es a
nd sn
apsh
ot
files
acc
urac
y. Im
plem
ent p
roce
ss to
en
sure
refr
esh
of su
mm
ary
tabl
es a
nd
snap
shot
file
s.
Mar
ch-
Apr
il
Gen
eral
repo
rting
inte
rfac
e D
rop
dow
n bo
x is
not
wid
e en
ough
to
com
plet
ely
disp
lay
long
trib
al n
ames
M
ajor
A
dd h
oriz
onta
l scr
oll b
ar so
the
full
nam
e ca
n be
vie
wed
. M
arch
Gen
eral
repo
rting
inte
rfac
e A
rapa
hoe
Trib
e of
the
Win
d R
iver
Trib
e lis
ted
twic
e in
stan
dard
repo
rt se
lect
ion
drop
dow
n m
enu.
Dat
a on
ly a
ssoc
iate
d w
ith o
ne n
ame.
Maj
or
C
ombi
ne n
ame
to re
ad “
Ara
paho
e an
d Sh
osho
ne T
ribes
of t
he W
ind
Riv
er
Res
erva
tion”
.
Mar
ch
Stan
dard
R
epor
ts
Poin
t Sou
rce
by N
ame
Rep
ort
Doe
s not
cor
rect
ly li
st fa
cilit
y na
mes
. In
so
me
case
s, so
urce
s fro
m d
iffer
ent s
tate
s ar
e in
clud
ed .
Crit
ical
D
ebug
and
fix.
M
arch
Gen
eral
usa
ge
Use
of t
ool i
s non
intu
itive
. Eve
n tra
ined
us
ers a
re li
kely
to fo
rget
how
to u
se it
ove
r tim
e.
Maj
or
Cre
ate
a ca
ptur
ed d
emo
sess
ion
and
prov
ide
an o
bvio
us li
nk to
it fo
r use
rs to
ge
t a q
uick
revi
ew o
n ho
w to
use
the
tool
.
Mar
ch
M
appi
ng T
ool
SVG
Vie
wer
N
o al
ert i
f the
SV
G V
iew
er is
not
inst
alle
d w
hen
the
user
atte
mpt
s to
use
the
tool
. M
ajor
Pr
ovid
e a
pop-
up b
ox a
lert
and
link
to th
e SV
G V
iew
er d
ownl
oad
page
. M
arch
13
Tabl
e 4-
2. M
inor
and
Triv
ial I
ssue
s
Are
a Fu
nctio
n Pr
oble
m(s
) Se
veri
ty
Lev
el
Solu
tions
/ Alte
rnat
e so
lutio
n T
imel
ine
Dat
a
Inve
ntor
y na
mes
are
not
suff
icie
ntly
de
scrip
tive.
M
inor
R
evis
e th
e na
mes
and
/or p
rovi
de re
adily
av
aila
ble
addi
tiona
l inv
ento
ry d
escr
iptio
ns
.
Mar
ch
Dat
a Su
bmitt
al
Men
u te
xt
Men
u op
tion
unde
r Dat
a M
anag
emen
t rea
ds
“File
/Dat
a Ex
port
Stat
us.”
Tr
ivia
l C
hang
e op
tion
to re
ad “
File
/Dat
a Im
port
Stat
us”
or F
ile/D
ata
Subm
ittal
Sta
tus.”
M
arch
Use
r que
ry se
lect
ion
Inve
ntor
y 5
- Tra
inin
g da
ta is
ava
ilabl
e to
se
lect
. M
inor
D
elet
e tra
inin
g da
ta fr
om th
e da
taba
se a
nd
rem
ove
refe
renc
e fr
om th
e w
eb in
terf
ace.
M
arch
Bro
wse
r ver
sion
s U
ser c
anno
t suc
cess
fully
logi
n if
usin
g th
e Fo
xfire
bro
wse
r. M
inor
A
ttem
pt to
deb
ug a
nd fi
x.
As
feas
ible
Ev
ents
and
Doc
umen
ts
page
s O
utda
ted
even
ts, d
isor
gani
zed
docu
men
ts.
Min
or
Rev
iew
for r
elev
ancy
, org
aniz
atio
n th
en
dele
te a
nd/o
r reo
rgan
ize.
A
s fe
asib
le
Gen
eral
web
in
terf
ace
Web
pag
e ba
nner
s “M
irror
ed”
imag
es n
ot a
esth
etic
ally
pl
easi
ng.
Triv
ial
Rep
lace
with
a v
arie
ty o
f im
ages
take
n at
W
RA
P C
lass
I ar
eas
As
feas
ible
C
LEA
R
Cle
ars g
eogr
aphi
cal s
elec
tion
but d
oes n
ot
clea
r res
ults
from
pre
viou
s sel
ectio
n.
Min
or
Cle
ar se
lect
ion
set,
rese
t sel
ect f
lag.
A
s fe
asib
le
Trib
al c
ount
y ov
erla
p fla
g Tr
ibal
and
cou
nty
data
is in
dat
abas
e bu
t w
hen
the
user
“m
ouse
’s o
ver”
the
coun
ty
the
text
doe
s not
refle
ct th
e st
ate
of th
e da
ta.
Min
or
Ensu
re fl
ags a
re se
t for
all
Trib
al v
s C
ount
y da
ta in
the
prod
uctio
n da
taba
se.
As
feas
ible
Fetc
h Fa
cilit
y D
ata
Not
cle
ar w
hat t
his c
heck
box
doe
s, ne
ed
clar
ity fo
r the
use
rs.
Min
or
Whe
n th
e ch
eckb
ox is
sele
cted
the
mes
sage
box
shou
ld p
op u
p to
tell
the
user
th
at th
is w
ill sl
ow th
e qu
ery
dow
n, n
ot
afte
r the
use
r has
initi
ated
the
quer
y.
As
feas
ible
Map
ping
Too
l
Prog
ress
bar
s D
ispl
ay o
f thr
ee p
rogr
ess b
ars w
ith n
o in
dica
tion
of p
urpo
se.
Min
or
Rem
ove
or d
eter
min
e pu
rpos
e an
d la
bel.
As
feas
ible
St
anda
rd
Rep
orts
Fi
re R
epor
ts
No
data
for r
epor
ts in
dat
abas
e.
Min
or
Dis
able
repo
rts u
ntil
the
data
is p
rese
nt.
Mar
ch
Expo
rt to
Exc
el
Dat
a sa
ved
as E
xcel
ver
sion
2.0
whi
ch m
ust
be o
pene
d in
rece
nt v
ersi
ons o
f Exc
el a
nd
re-s
aved
bef
ore
impo
rting
dat
a fr
om E
xcel
in
to A
cces
s.
Min
or
Upd
ate
func
tion
if po
ssib
le to
save
dat
a as
a
late
r ver
sion
of E
xcel
. A
s fe
asib
le
Dat
a Ex
port
Are
a So
urce
by
SCC
Sn
apsh
ot fi
le
Inva
lid c
omm
a de
limite
d fo
rmat
resu
lting
in
the
dat
a fo
r the
Inve
ntor
y Y
ear b
eing
lis
ted
in th
e V
OC
pol
luta
nt c
olum
n.
Min
or
Deb
ug a
nd fi
x.
As
feas
ible
Dat
a re
triev
al p
rogr
ess
Win
dow
sim
ply
disp
lays
“Lo
adin
g D
ata”
w
ith n
o in
dica
tion
of p
rogr
ess o
r tha
t the
sy
stem
is w
orki
ng.
Min
or
Add
pro
gres
s bar
or s
ome
othe
r ani
mat
ed
indi
cato
r.
As
feas
ible
A
dhoc
Que
ry
SCC
cod
es li
stin
g Th
e SC
C-4
list
is n
ot n
umer
ical
ord
ered
. M
inor
O
rder
the
list.
As
feas
ible
14
Table 4-3. Other Action Items
Item Timeline Emissions Forum comments on draft Critical Functionality Report requested within 2 weeks
Monday, March 12
Final Critical Functionality Report Friday, March 16 Participate with tribes to implement inventory changes base on review of tribal/state emissions overlap
To begin in April, others scheduled as needed
New Data uploads -2005 data, more versions of 2018 data -will require QA/QC, and potentially gap filling
To begin with one state in April, others to occur as ready
Webinar training, basic intro to site; caveats: -all data may not yet be in the database -some features may still be under construction
First one in April, others scheduled as needed
Live training: -many issues expected to be resolved
June
5 Recommended Future Enhancements Since taking over the EDMS hosting responsibilities over the last 3 months, ARS’ vision
of the path that EDMS needs to take has not changed from the one presented in our proposal. The most important future enhancement is to link the EDMS to the TSS to provide data review and analysis tools that would be too expensive to implement in the EDMS. 5.1 Link the EDMS to the TSS The EDMS should be a relatively simple warehouse of emissions data accessible to WRAP states and tribes. There is a need for users to be able to access these data for a variety of applications, but it is important that the EDMS functionality be carefully focused to critical tasks. The WRAP is currently developing its Technical Support System (TSS) which will soon be capable of storing, analyzing, and presenting emissions data (geographically, graphically, and in tabular format). Tools already developed and supported by WRAP should be leveraged to enhance or compliment the EDMS; a cost-effective and relatively straight forward alternative to re-developing the same tools in the EDMS environment. With the appropriate linkage, the EDMS would continue to be a repository and clearinghouse for quality assured emissions data, and the TSS would lend its functionality and variety of GIS and analytical tools to the EDMS database. The main task in this enhancement is to transform the existing set of EDMS database tables into a true data warehouse. This will be accomplished by removing most of the external programming from the QA/QC process and taking advantage of functionality that is built into the Oracle database.
The EDMS mapping component should be transformed to true GIS functionality. We recommend moving to the ESRI suite of tools and data storage structures. In moving from the
15
static SVG platform to the more robust ESRI platform, EDMS users will be able to view and query base and inventory data in a much more stable, widely accepted and supported environment. This will simplify the printing and data downloads from the EDMS as well as using a more standard GIS interface. ARS could undertake this task and spend 3 to 6 months of development time in setting up the Spatial Database Engine, the Internet Mapping server and writing code to integrate ESRI products into the application, but we do not believe that this approach would best serve WRAP’s needs. Instead, we recommend leveraging existing licenses and development that is currently being performed for the TSS at CIRA. In recent discussions with CIRA we have been informed they are on the path to moving their internal mapping components to the ESRI suite of products, potentially with other third party GIS tools, but an expected completion date is not yet known.
The EDMS data structure would be visible to the TSS mapping and query tool by either transferring a published, fully QA’d database to the TSS server or providing a read-only access to the EDMS database hosted at ARS. The advantages of transferring a published database up to the TSS are redundancy and integrity. Data would be available to users even if the ARS main database is down for scheduled maintenance. Data would also be available to be analyzed in conjunction with other relevant data sets providing another data integrity check. We have met with CIRA to discuss the coupling strategy and have decided on an initial data transfer protocol to be used.
A schedule for further work on linkage between the EDMS and the TSS will be
dependent on the time required to implement the recommendations in this report and on CIRA’s work on the TSS GIS components. Updates on EDMS-TSS linkage will be provided in future contract status reports.
5.2 Host the EDMS at CIRA
Given expected future funding constraints facing the WRAP, it may make fiscal sense for the EDMS to eventually be hosted at CIRA to consolidate the WRAP’s hosting costs. At this time, the best way to facilitate hosting the EDMS at CIRA would be to migrate the database from the Oracle RDBMS to the Microsoft SQLServer RDBMS. Reasons to do so include:
• Oracle products are not currently covered under CIRA’s suite of educational software
licenses.
• CIRA is experienced in and proficient at hosting systems on the Microsoft platform.
• Implementing GIS services for the EDMS will be less complicated. However, it is too early to recommend a specific course of action on this topic. This move would require direction from the WRAP at a future date.
16
Appendix A
A-1
Tabl
e A
-1. E
DM
S Tr
ansi
tion
Req
uire
men
ts
Ite
m
Req
uire
men
ts
Proj
ecte
d D
ate
of
Com
plet
ion
Not
es
AR
S N
otes
Pro
duct
ion
Ora
cle
Dat
abas
e O
racl
e E
xpor
t ver
sion
9.
1 or
hig
her
Fu
ll D
atab
ase
Exp
ort
FULL
=Y (a
ll ob
ject
s in
clud
ing
trigg
ers,
etc
.) 11
/17/
2006
O
n P
echa
n FT
P -
Com
plet
e
Li
mit
dum
p fil
e si
ze
FILE
SIZ
E=2
GB
In a
bove
exp
ort-
Com
plet
e
Impo
rt in
to 3
2-bi
t OS
R
EC
OR
DLE
NG
TH=
In
abo
ve e
xpor
t- C
ompl
ete
D
o no
t com
pres
s
In a
bove
exp
ort-
Com
plet
e
Dum
p fil
es o
n D
VD
Tw
o co
pies
In a
bove
exp
ort-
Com
plet
e
Yes
.
O
racl
e E
xpor
t Com
man
d
Text
file
11
/17/
2006
O
n P
echa
n FT
P- C
ompl
ete
Yes
.
Ora
cle
Exp
ort L
og fi
le
Text
file
11
/17/
2006
O
n P
echa
n FT
P- C
ompl
ete
Yes
.
Ora
cle
conf
igur
atio
n fil
es
CO
NFI
G.O
RA
, IN
IT.O
RA
, TN
SN
AM
ES
.OR
A,
LIS
TEN
ER
.OR
A, e
tc.
12/1
1/20
06
On
Pec
han
FTP-
Com
plet
e (1
2/19
/200
6)
Yes
.
Test
Ora
cle
Dat
abas
e S
ame
as p
rodu
ctio
n (re
quire
d on
ly if
it
cont
ains
dat
a or
ap
plic
atio
n co
mpo
nent
s no
t con
tain
ed in
the
prod
uctio
n D
B.)
12/1
5/20
06
On
Pec
han
FTP-
Com
plet
e Th
e fil
e w
as p
rovi
ded.
How
ever
, the
con
tent
s ar
e id
entic
al to
the
tabl
es in
the
prod
uctio
n da
taba
se.
ED
MS
-rela
ted
data
not
in O
racl
e
Sou
rce
data
file
s S
tand
ard
file
form
ats;
A
SC
II, E
xcel
, Acc
ess
12/3
1/20
06
On
Pec
han
FTP-
Com
plet
e
A lo
t of f
iles
post
ed. A
RS
has
cop
ied
to a
net
wor
k dr
ive
and
crea
ted
two
DVD
cop
ies.
Doc
umen
tatio
n (P
roje
ct w
eb s
ite
cont
ents
– A
LL D
OC
UM
EN
TS)
Sou
rce
data
info
rmat
ion,
st
atus
, etc
. 12
/31/
2006
O
n P
echa
n FT
P- C
ompl
ete
Yes
, doc
s fro
m th
e do
cum
ents
list
on
the
ED
MS
web
si
te (a
long
with
man
y un
rela
ted
docs
). E
mis
sion
Inve
ntor
ies
Doc
umen
tatio
n V
ersi
on d
efin
ition
s, d
ata
sour
ces,
QA
pro
cess
es
appl
ied,
etc
.
11/1
7/20
06
On
curre
nt
http
://w
ww
.wra
pedm
s.or
g si
te
The
inve
ntor
y de
scrip
tion
docu
men
ts d
o no
t alw
ays
clea
rly s
tate
dat
a su
bmitt
al s
tatu
s in
the
data
base
. M
ost t
ribal
sub
mis
sion
s in
dica
te “u
nder
ana
lysi
s”. W
hat
addi
tiona
l doc
umen
tatio
n is
ava
ilabl
e re
gard
ing
anal
ysis
? W
hat i
s th
e st
atus
of I
nven
tory
10?
The
Inve
ntor
y 10
de
scrip
tion
docu
men
t doe
s no
t ind
icat
e da
taba
se
stat
us. T
he E
DM
S_P
RD
tabl
es d
eliv
ered
by
Pec
han
do n
ot in
clud
e an
y re
cord
s w
here
the
Inve
ntor
y_Id
fiel
d co
ntai
ns 1
0. S
ome
of th
e st
agin
g ta
bles
do
(ED
MS
_TXN
, ED
MS
_TXR
, ED
MS
_STG
). Th
e vb
Rep
orts
cla
ss p
oste
d by
Pec
han
on 1
2/9
uses
a
hard
cod
ed O
DB
C c
onne
ctio
n to
“edm
s_pr
d” w
hen
the
quer
y cr
iteria
refe
r to
Inve
ntor
y 10
. Thi
s in
dica
tes
that
pe
rhap
s da
ta fo
r Inv
ento
ry 1
0 w
ere
bein
g re
triev
ed
from
a d
iffer
ent d
atab
ase
inst
ance
on
the
Pec
han
site
w
hen
com
paris
on te
stin
g oc
curre
d..
A-2
Item
R
equi
rem
ents
Pr
ojec
ted
Dat
e of
C
ompl
etio
n
Not
es
AR
S N
otes
App
licat
ion
Sou
rce
code
A
ll as
p, h
tml,
js, a
sp,
imag
e, a
nd V
B fi
les.
Any
ot
her s
crip
ts u
sed
by th
e ap
plic
atio
n
12/6
/200
6 O
n Pe
chan
FTP
- C
ompl
ete
Add
ition
al c
ode
post
ed 1
2/29
. A
RS
is u
nabl
e to
ver
ify
if w
e ha
ve th
e la
test
app
licat
ion
code
or n
ot.
Appl
icat
ion
docu
men
tatio
n S
ourc
e co
de c
onte
nts
docu
men
tatio
n (fi
le
defin
ition
s an
d de
pend
enci
es, e
tc.),
E-R
di
agra
ms,
pro
cess
flow
ch
arts
, dat
a flo
w c
harts
, et
c.
11/1
7/20
06
At
http
://pr
ojec
ts.p
echa
n.co
m/e
dms
unde
r “D
evel
opm
ent P
lan”
- C
ompl
ete
Hig
h le
vel o
nly,
no
deta
ils o
n ob
ject
dep
ende
ncie
s,
proc
esse
s, ta
ble
rela
tions
hips
, sto
red
proc
edur
es, e
tc.
Det
aile
d in
form
atio
n re
gard
ing
the
XM
LtoM
DB
obj
ect
and
proc
essi
ng o
f dat
a su
bmis
sion
s is
esp
ecia
lly
impo
rtant
.
Use
r doc
umen
tatio
n D
ocum
ents
in P
DF
or
Wor
d fo
rmat
11
/17/
2006
O
n cu
rrent
ht
tp://
ww
w.w
rape
dms.
org
site
- C
ompl
ete
Yes
.
IIS C
onfig
urat
ion
IIS c
onfig
urat
ion
files
12
/13/
2006
O
n P
echa
n FT
P- C
ompl
ete
Not
foun
d bu
t no
long
er n
eede
d.
Dom
ain
nam
e
AR
S a
utho
rized
to
acce
ss re
gist
rar
12/1
5/20
06
On
Pec
han
FTP-
Com
plet
e Y
es.
Pro
ject
web
site
con
tent
s D
ocum
ents
in P
DF
or
Wor
d fo
rmat
12
/31/
2006
O
n P
echa
n FT
P- C
ompl
ete
Not
foun
d bu
t AR
S h
as m
anua
lly d
ownl
oade
d al
l doc
s fro
m th
e si
te.
WR
AP
ow
ned
softw
are
Li
cens
es a
nd in
stal
latio
n m
edia
to a
ll E
DM
S
deve
lopm
ent t
ools
or
othe
r sof
twar
e ow
ned
by
WR
AP
N/A
Th
ere
is n
one.
D
eliv
ered
AS
P m
ail,
Cha
rts,
Upl
oad
- com
plet
e
Yes
.
Appl
icat
ion
upda
tes
Log
of a
ll da
ta a
nd/o
r ap
plic
atio
n m
odifi
catio
ns
mad
e si
nce
10/1
/200
6.
12/6
/200
6 12
/31/
2006
App
licat
ion
- to
be s
ent w
ith
late
st s
ourc
e co
de. –
no
log
is
kept
. D
ata
– to
be
incl
uded
in th
e cl
osin
g do
cum
enta
tion
for t
he
proj
ect.
Bug
zilla
reco
rds
EM
DS
-rela
ted
Bug
zilla
re
cord
s in
CS
V fo
rmat
UN
C c
anno
t ret
rieve
dat
a A
RS
has
scr
een
capt
ured
reco
rds.
Dat
a so
urce
s R
aw d
ata
sour
ces
arch
ive
12/3
1/20
06
Tran
sfer
red
on F
TP s
erve
r -
Com
plet
e Y
es.
SV
G F
iles
11
/30/
2006
O
n P
echa
n FT
P - C
ompl
ete
Yes
. S
ourc
e co
de fo
r the
“S
ched
ule_
Adho
c_M
odel
ling_
PRD
.exe
12/1
9/20
06
On
Pec
han
FTP
- Com
plet
e Y
es.
A-3
Tabl
e A
-2. E
DM
S R
equi
rem
ents
Cat
egor
y/
Subc
ateg
ory
Req
uire
men
t R
emar
ks
Sour
ce *
Dat
abas
e
Pro
vide
com
preh
ensi
ve e
mis
sion
s tra
ckin
g an
d re
porti
ng c
apab
ilitie
s re
leva
nt to
Sta
te/T
ribal
Impl
emen
tatio
n P
lans
(SIP
s/TI
Ps)
for c
lean
air
corr
idor
s (C
AC
), an
d st
atio
nary
SO
2 so
urce
s, a
s w
ell a
s m
obile
and
fire
so
urce
s.
Mee
ts m
ost r
equi
rem
ents
; fire
em
issi
ons
curr
ently
not
ava
ilabl
e on
the
ED
MS
. 2
Sup
port
the
SO
2 em
issi
ons
from
elig
ible
sta
tiona
ry s
ourc
es w
ithin
sta
tes
or tr
ibal
rese
rvat
ions
par
ticip
atin
g in
S
ectio
n 30
9 tra
ckin
g pu
rsua
nt to
the
SO
2 A
nnex
pro
gram
. M
eets
requ
irem
ent
2
Con
form
to th
e R
PO
Dat
a E
xcha
nge
Pro
toco
l S
truct
ure
mig
ht c
onfo
rm b
ut th
ere
is n
o fu
nctio
n to
exp
ort d
ata
in R
PO
form
at
2
Stru
ctur
e m
ust f
acili
tate
the
abili
ty to
read
ily id
entif
y, s
ort a
nd e
xtra
ct in
form
atio
n by
var
ious
cat
egor
ies,
in
aggr
egat
e an
d/or
com
bina
tion
incl
udin
g, b
ut n
ot li
mite
d to
the
follo
win
g: p
oint
, are
a, ro
ad, n
on-r
oad,
etc
. S
tatic
sum
mar
y ta
bles
are
pre
-gen
erat
ed to
pr
ovid
e da
ta to
repo
rts
2
Rep
ort a
ll vi
sibi
lity-
impa
iring
pol
luta
nt e
mis
sion
s M
eets
requ
irem
ent
Incl
ude
all s
ourc
es a
nd th
eir a
ctiv
ity d
ata
(at l
east
) on
an a
nnua
l lev
el a
nd a
cou
nty
leve
l A
lthou
gh A
ctiv
ity d
ata
stru
ctur
es a
re p
rese
nt,
no d
ata
exis
t and
no
data
sub
mitt
al p
roce
ss
for a
ctiv
ity d
ata
exis
ts
Gen
eral
E
mis
sion
s S
tora
ge
Acc
ept a
nd re
port
data
in th
e N
EI f
orm
at
Mee
ts re
quire
men
t
3
Cat
alog
, man
age,
and
repo
rt da
ta o
n sp
ecifi
c fa
cilit
ies.
M
eets
requ
irem
ent
Sto
re p
oint
so
urce
dat
a A
ccom
mod
ate
the
vary
ing
repo
rting
thre
shol
ds a
s de
fined
by
the
agen
cy p
rovi
ding
the
data
M
eets
requ
irem
ent
Man
age
and
repo
rt da
ta o
n th
e ag
greg
atio
n of
faci
litie
s an
d ac
tiviti
es th
at d
o no
t mee
t the
sta
tiona
ry p
oint
so
urce
thre
shol
d va
lues
, exc
ludi
ng fi
re a
nd w
indb
low
n du
st s
ourc
es a
nd in
clud
ing
open
bur
ning
act
iviti
es.
Mee
ts re
quire
men
t
Abi
lity
to m
anag
e in
form
atio
n on
indu
stria
l, co
mm
erci
al, a
nd/o
r res
iden
tial s
ourc
es. O
rgan
ize
area
sou
rce
emis
sion
s by
cou
nty
and
SC
C o
n an
ann
ual t
empo
ral r
esol
utio
n ba
sis.
M
eets
requ
irem
ent
Acc
omm
odat
e va
riatio
ns in
S/L
/T s
ourc
e de
finiti
ons.
M
eets
requ
irem
ent
Sto
re a
rea
sour
ce d
ata
Pro
vide
a m
echa
nism
to h
ouse
the
info
rmat
ion
abou
t the
leve
l of a
ctiv
ity a
ssoc
iate
d w
ith a
par
ticul
ar a
rea
sour
ce, t
he e
mis
sion
fact
or a
nd th
e em
issi
ons.
A
lthou
gh A
ctiv
ity d
ata
stru
ctur
es a
re p
rese
nt,
no d
ata
exis
t and
no
data
sub
mitt
al p
roce
ss
for a
ctiv
ity d
ata
exis
ts
Cat
alog
, man
age,
and
repo
rt em
issi
ons
data
from
on-
road
sou
rces
. M
eets
requ
irem
ent
Sto
re e
mis
sion
fact
ors
deve
lope
d ex
tern
al to
the
syst
em u
sing
the
EP
A’s
MO
BIL
E m
odel
or C
AR
B’s
EM
FAC
m
odel
. Em
issi
on fa
ctor
s in
clud
e bo
th e
xhau
st a
nd n
on-e
xhau
st e
mis
sion
s.
Not
sur
e if
requ
irem
ent m
et a
t thi
s tim
e
Sto
re a
pplic
able
veh
icle
mile
s tra
vele
d (V
MT)
dat
a an
d pr
ovid
e us
ers
with
the
abili
ty to
upd
ate
data
ove
r tim
e by
mod
ifyin
g V
MT
data
as
avai
labl
e an
d em
issi
on fa
ctor
s as
nee
ded.
A
lthou
gh d
ata
stru
ctur
es d
esig
ned
to h
old
VM
T ar
e pr
esen
t, no
dat
a ex
ist a
nd n
o da
ta
subm
ittal
pro
cess
for V
MT
data
exi
sts
Sto
re d
ust e
mis
sion
s ca
lcul
ated
usi
ng A
P-4
2 or
EP
A’s
PA
RT5
mod
el.
Mee
ts re
quire
men
t A
bilit
y to
org
aniz
e by
cou
nty
and
SC
C.
Mee
ts re
quire
men
t
Acc
omm
odat
e co
unty
-leve
l em
issi
ons
estim
ates
pre
pare
d us
ing
the
NO
NR
OA
D 2
002
mod
el, a
nd h
ave
the
abili
ty to
man
age
seas
onal
or a
nnua
l tem
pora
l allo
catio
ns.
Mee
ts re
quire
men
t
Sto
re
mob
ile
sour
ce d
ata
Pro
vide
the
data
ele
men
ts s
uffic
ient
for S
ectio
n 30
9 tra
ckin
g, a
nd to
faci
litat
e sp
ecia
l rep
ortin
g ca
pabi
lity
defin
ed in
the
Nee
ds A
sses
smen
t doc
umen
t. M
eets
requ
irem
ent
Sto
re d
ata
gene
rate
d by
EP
A’s
BE
IS m
odel
, spe
cific
ally
the
annu
al e
mis
sion
s.
Mee
ts re
quire
men
t S
tore
bi
ogen
ic
sour
ce d
ata
Sto
re a
nd m
anag
e co
unty
-leve
l win
dblo
wn
dust
dat
a re
view
ed a
nd a
ppro
ved
by th
e S
/L/T
age
ncie
s pr
ior t
o in
clus
ion.
Sup
port
stor
age
of a
nnua
l em
issi
ons
data
and
acc
omm
odat
e fin
er te
mpo
ral r
esol
utio
ns. C
onve
rt da
ta
from
grid
to c
ount
y le
vel d
ata
for S
/L/T
revi
ew.
Mee
ts s
ome
requ
irem
ents
; onl
y an
nual
re
solu
tion
avai
labl
e
Est
imat
e fir
e em
issi
ons
from
wild
fires
, pre
scrib
ed fi
re, w
ildla
nd b
urni
ng a
nd a
gric
ultu
ral b
urni
ng a
ctiv
ities
.
Fire
E
mis
sion
s S
uppo
rt th
e W
RA
P F
ire T
rack
ing
Sys
tem
s m
etho
dolo
gy, w
hich
def
ines
ess
entia
l and
opt
iona
l dat
a el
emen
ts
purs
uant
to c
alcu
latin
g th
e em
issi
ons
of fi
re, a
s w
ell a
s a
met
hod
to c
alcu
late
them
. Inc
lude
fiel
ds to
trac
k th
e ca
lcul
atio
n m
etho
d fo
r an
emis
sion
s re
cord
.
Cur
rent
ly fi
re d
ata
are
not s
tore
d in
the
ED
MS
due
to p
ast p
erfo
rman
ce is
sues
2
A-4
Cat
egor
y/
Subc
ateg
ory
Req
uire
men
t R
emar
ks
Sour
ce *
Incl
ude
estim
ates
of b
oth
plan
ning
ann
ual e
mis
sion
s an
d ac
tual
dai
ly e
mis
sion
s to
sup
port
mod
elin
g an
d re
gula
tory
nee
ds.
D
atab
ase
Aud
iting
A
utom
ated
aud
it co
ntro
l and
dat
a ve
rsio
n tra
ckin
g de
sign
ed in
to th
e st
orag
e da
taba
se. A
ssur
e ch
ange
s to
the
data
base
or d
ata
are
thor
ough
ly d
ocum
ente
d an
d re
tain
ed, p
rovi
ding
the
abili
ty to
rest
ore
prio
r dat
a if
nece
ssar
y.
Alth
ough
the
data
stru
ctur
e ex
ists
to s
tore
au
dit d
ata,
no
data
exi
st a
nd n
o fu
nctio
ns
have
bee
n id
entif
ied
that
gen
erat
e au
dit d
ata
Dat
a S
ubm
ittal
A
ccep
t inv
ento
ry d
ata
that
is N
IF 3
.0 c
ompl
iant
in M
S A
cces
s, A
SC
II an
d X
ML
form
at.
Acc
epts
MS
Acc
ess
form
at o
nly
Per
form
dat
a an
alys
is q
ualit
y as
sura
nce/
valid
atio
n an
d sc
rub
(adj
ust)
data
; aug
men
t dat
a.
Aut
omat
ed p
roce
sses
are
sus
pect
, DB
A
initi
ated
pro
cess
es a
re u
ndoc
umen
ted.
A
ccep
t Act
ivity
Det
ail d
ata
in M
S A
cces
s or
AS
CII
fixed
-wid
th fo
rmat
. D
oes
not m
eet r
equi
rem
ent.
Allo
w u
sers
to s
ubm
it Fi
re d
ata
as a
sep
arat
e so
urce
type
, alth
ough
it is
sto
red
as a
sub
set o
f the
poi
nt s
ourc
e da
ta.
Doe
s no
t mee
t req
uire
men
t.
Upl
oad
Val
idat
e th
e st
ruct
ure
of th
e su
bmitt
al. I
f the
stru
ctur
e is
inva
lid, s
end
a m
essa
ge to
the
data
pro
vide
r with
in 2
4 ho
urs
to in
dica
te th
at th
e da
ta s
ubm
ittal
cou
ld n
ot b
e re
ad a
nd n
ote
failu
re in
the
data
base
. S
truct
ure
is v
alid
ated
, no
auto
mat
ed p
roce
ss
is in
pla
ce to
not
ify th
e da
ta p
rovi
der
Impo
rt in
to a
hol
ding
are
a fo
r qua
lity
revi
ew.
Mee
ts re
quire
men
t Th
e qu
ality
revi
ew in
clud
es (b
ut is
not
nec
essa
rily
limite
d to
) che
ckin
g fo
r key
fiel
ds, r
efer
entia
l int
egrit
y,
dupl
icat
e re
cord
s, a
nd m
issi
ng e
mis
sion
info
rmat
ion
(nul
l em
issi
on n
umer
ic v
alue
s or
em
issi
on u
nit
num
erat
ors)
, con
firm
ing
valid
cod
e va
lues
(for
exa
mpl
e, S
IC, S
CC
, uni
ts o
f mea
sure
, etc
.), v
alid
val
ues
and
rang
es in
par
ticul
ar fi
elds
(for
exa
mpl
e, s
tack
hei
ght c
heck
s, e
xit v
eloc
ity c
heck
s, la
titud
e an
d lo
ngitu
de c
heck
s ag
ains
t cou
nty
boun
darie
s, a
ppro
pria
te P
M10
to P
M2.
5 rela
tions
hips
), an
d se
ason
al th
roug
hput
per
cent
ages
.
Par
tially
mee
ts re
quire
men
ts b
ut m
etho
ds
are
susp
ect
Ret
urn
a re
port
to th
e da
ta p
rovi
der w
ithin
24
hour
s of
the
QA
revi
ew li
stin
g th
e er
rors
and
thei
r sev
erity
leve
l fo
und
in th
e su
bmitt
al. A
sev
erity
leve
l of “
Crit
ical
” mea
ns th
at th
e da
ta h
as n
ot b
een
acce
pted
. Cur
rent
ly, a
ll er
rors
are
pro
cess
ed a
s “C
ritic
al.”
Doe
s no
t mee
t req
uire
men
t; no
pro
cess
for
gene
ratin
g a
usef
ul re
port
and
for n
otify
ing
the
prov
ider
of p
robl
ems
have
bee
n di
scov
ered
Lo
g su
bmitt
al s
teps
thro
ugho
ut th
e pr
oces
s.
Log
data
has
bee
n ge
nera
ted
but o
nly
the
TXN
sta
ge is
refe
renc
ed. T
he p
roce
ss o
f m
ovin
g da
ta b
eyon
d th
is s
tage
has
not
bee
n lo
gged
in th
e da
taba
se.
QA
/QC
Insu
re th
at a
dat
a pr
ovid
er h
as n
ot re
porte
d da
ta fo
r a d
iffer
ent j
uris
dict
ion
and
the
orig
in o
f all
data
is c
lear
ly
disc
erna
ble
in th
e ex
iting
ED
MS
des
ign
and
prac
tice
and
revi
ew th
e su
bmitt
ed d
ata
for c
ompl
eten
ess,
acc
urac
y an
d re
ason
able
ness
.
Doe
s no
t mee
t req
uire
men
t; no
aut
omat
ed o
r m
anua
l pro
cess
es h
ave
been
dis
cove
red.
1
Use
r/Adm
in
Pro
vide
a m
odul
e th
at a
llow
s E
DM
S a
dmin
istra
tors
to m
anag
e us
ers,
pas
swor
ds a
nd a
ssig
n sy
stem
acc
ess
right
s us
ing
the
on-li
ne, w
eb-b
ased
inte
rface
. M
eets
requ
irem
ent
Pro
vide
a u
ser r
egis
tratio
n fu
nctio
n, a
nd a
LIS
TSE
RV
func
tion
so u
sers
can
be
notif
ied
of E
DM
S u
pdat
es a
nd
othe
r per
tinen
t inf
orm
atio
n co
ncer
ning
the
ED
MS
. P
artia
lly m
eets
; no
LIS
TSE
RV
func
tion
exis
ts
to o
ur k
now
ledg
e
Pro
duce
and
del
iver
an
on-li
ne U
ser’s
Man
ual d
ocum
entin
g th
e us
e an
d fu
nctio
n of
the
ED
MS
. The
Use
r’s
Man
ual s
hall
desc
ribe
how
to th
e us
e ea
ch m
odul
e of
the
syst
em, a
nd s
hall
prov
ide
a re
fere
nce
to u
sers
on
the
gene
ral u
se o
f the
sys
tem
as
wel
l as
spec
ific
info
rmat
ion
such
as
a gl
ossa
ry o
f nom
encl
atur
e, h
ow to
obt
ain
supp
ort,
and
frequ
ently
ask
ed q
uest
ions
and
thei
r ans
wer
s.
Mee
ts re
quire
men
t
1
Th
e w
eb in
terfa
ce s
hall
adhe
re to
Sec
tion
508
of th
e A
mer
ican
s w
ith D
isab
ilitie
s A
ct re
quiri
ng a
ll co
mpu
ter W
eb
site
s an
d on
-line
app
licat
ions
to m
eet t
he s
peci
ficat
ions
set
forth
in 3
6 C
ode
of F
eder
al R
egul
atio
ns (C
FR) P
art
7 11
94, E
lect
roni
c an
d In
form
atio
n Te
chno
logy
Acc
essi
bilit
y S
tand
ards
.
This
requ
irem
ent i
s re
fere
nced
as
bein
g re
solv
ed b
y ad
ding
text
to th
e Te
rms
&
Con
ditio
ns p
age
of th
e E
DM
S.
2/1
Rep
orts
A
sum
mar
y re
port
of th
e an
nual
WR
AP
em
issi
on in
vent
ory,
com
pile
d at
the
coun
ty a
nd re
serv
atio
n le
vels
and
to
tale
d fo
r eac
h st
ate,
trib
e, a
nd th
e W
RA
P re
gion
, for
all
pollu
tant
s, b
roke
n do
wn
by p
oint
, are
a, m
obile
, fire
, bi
ogen
ic, a
nd w
ind-
blow
n du
st s
ourc
e ca
tego
ries,
and
by
sum
med
tota
l em
issi
ons
for a
ll si
x so
urce
cat
egor
ies.
A
sum
mar
y re
port
of th
e an
nual
WR
AP
em
issi
ons
from
the
stat
iona
ry p
oint
sou
rces
in e
ach
coun
ty a
nd
rese
rvat
ion
and
the
stat
iona
ry p
oint
sou
rces
for e
ach
stat
e, tr
ibe
and
the
entir
e re
gion
(bro
ken
dow
n by
pla
nt
nam
e), f
or e
ach
pollu
tant
.
S
tand
ard
Rep
orts
A s
umm
ary
repo
rt of
the
annu
al W
RA
P e
mis
sion
s fro
m th
e st
atio
nary
poi
nt s
ourc
es in
eac
h co
unty
and
All
repo
rting
func
tions
mee
t min
imum
re
quire
men
ts. U
ses
stat
ic ta
bles
to re
port
from
inst
ead
of li
ve d
ata
sour
ce.
3
A-5
Cat
egor
y/
Subc
ateg
ory
Req
uire
men
t R
emar
ks
Sour
ce *
rese
rvat
ion
and
the
stat
iona
ry p
oint
sou
rces
for e
ach
stat
e, tr
ibe
and
the
entir
e re
gion
(bro
ken
dow
n by
SC
C
code
), fo
r eac
h po
lluta
nt.
A s
umm
ary
repo
rt of
the
annu
al W
RA
P e
mis
sion
s fro
m th
e ar
ea s
ourc
es in
eac
h co
unty
and
rese
rvat
ion
and
the
area
sou
rces
for e
ach
stat
e, tr
ibe
and
the
entir
e re
gion
(bro
ken
dow
n by
SC
C c
ode)
, for
eac
h po
lluta
nt.
A s
umm
ary
repo
rt of
the
annu
al W
RA
P e
mis
sion
s fro
m th
e “T
op 1
0” s
tatio
nary
poi
nt s
ourc
es in
eac
h co
unty
an
d re
serv
atio
n an
d th
e “T
op 1
0” s
tatio
nary
poi
nt s
ourc
es fo
r eac
h st
ate,
trib
e an
d th
e en
tire
regi
on (b
roke
n do
wn
by S
CC
cod
e), f
or e
ach
pollu
tant
. A
sum
mar
y re
port
of th
e an
nual
WR
AP
em
issi
ons
from
the
“Top
10”
are
a so
urce
s in
eac
h co
unty
and
re
serv
atio
n an
d th
e “T
op 1
0” a
rea
sour
ces
for e
ach
stat
e, tr
ibe
and
the
entir
e re
gion
(bro
ken
dow
n by
SC
C
code
), fo
r eac
h po
lluta
nt.
A s
umm
ary
repo
rt of
the
annu
al W
RA
P e
mis
sion
s fro
m o
n-ro
ad m
obile
sou
rces
in e
ach
coun
ty a
nd re
serv
atio
n an
d on
-roa
d m
obile
sou
rces
for e
ach
stat
e, tr
ibe
and
the
entir
e re
gion
(bro
ken
dow
n by
the
sixt
een
(16)
mob
ile
sour
ce c
ateg
orie
s), f
or e
ach
pollu
tant
and
dus
t fro
m p
aved
and
unp
aved
road
. A
sum
mar
y re
port
of th
e an
nual
WR
AP
em
issi
ons
from
non
-roa
d m
obile
sou
rces
in e
ach
coun
ty a
nd
rese
rvat
ion
and
non-
road
mob
ile s
ourc
es fo
r eac
h st
ate,
trib
e, a
nd th
e en
tire
regi
on (b
roke
n do
wn
by S
CC
co
de),
for e
ach
pollu
tant
. A
sum
mar
y re
port
of th
e an
nual
WR
AP
em
issi
ons
from
fire
sou
rces
in e
ach
coun
ty a
nd re
serv
atio
n an
d fir
e so
urce
s fo
r eac
h st
ate,
trib
e, a
nd th
e en
tire
regi
on (b
roke
n do
wn
by th
e 3
fire
cate
gorie
s (w
ildfir
e, p
resc
ribed
w
ild la
nd b
urni
ng, a
nd a
gric
ultu
ral b
urni
ng a
ctiv
ities
), fo
r eac
h po
lluta
nt.
A s
umm
ary
repo
rt of
the
annu
al W
RA
P e
mis
sion
s fro
m b
ioge
nic
sour
ces
in e
ach
coun
ty a
nd re
serv
atio
n an
d bi
ogen
ic s
ourc
es fo
r eac
h st
ate,
trib
e, a
nd th
e en
tire
regi
on (b
roke
n do
wn
by e
mis
sion
sou
rce
nam
e).
Dat
a re
ports
in th
e N
EI I
nput
For
mat
Ver
sion
3.0
(NIF
V3.
0) fo
r sub
mitt
al to
the
EP
A u
nder
the
CE
RR
. Fo
r sta
tiona
ry p
oint
sou
rces
, dat
a re
ports
for a
ll em
issi
on p
oint
s on
site
by
text
des
crip
tion
nam
e an
d by
Sta
ck
ID, f
or N
EI f
ile fo
rmat
sta
ck p
aram
eter
s (S
TKH
GT,
STK
DIA
M, S
TKTE
MP
, STK
FLO
W, S
TKV
EL)
, pro
duct
ion
rate
s (B
OIL
CA
P, C
AP
_UN
ITS
, TH
RU
PU
T, M
AX
RA
TE, N
ETD
C),
fuel
par
amet
ers
(HE
ATC
ON
, SU
LFC
ON
, A
SH
CO
N),
stan
dard
indu
stria
l cla
ssifi
catio
n co
de (S
IC),
loca
tion
(LA
TC, L
ON
G),
and
emis
sion
con
trols
("
pollu
tant
"_C
E, "
pollu
tant
"_C
PR
I, "p
ollu
tant
"_C
SE
C).
For s
tatio
nary
poi
nt s
ourc
es, d
ata
repo
rts fo
r all
emis
sion
poi
nts
on s
ite b
y te
xt d
escr
iptio
n na
me
and
by S
tack
ID
, for
act
ual e
mis
sion
rate
s of
eac
h po
lluta
nt, o
n an
ann
ual (
tpy)
and
on
a sh
ort t
erm
(pou
nds
per h
our)
bas
is.
This
em
issi
on d
ata
will
be
sum
med
for a
cum
ulat
ive
tota
l of e
mis
sion
s fro
m e
ach
stat
iona
ry p
oint
sou
rce.
Ad
Hoc
Q
uerie
s U
sers
sha
ll ha
ve th
e ab
ility
to d
evel
op a
nd e
xecu
te u
ser-
defin
ed q
uerie
s, a
nd o
utpu
t the
resu
lt se
t in
a va
riety
of
form
ats,
suc
h as
thro
ugh
an a
d-ho
c re
port
writ
er.
Mee
ts m
inim
um re
quire
men
ts
1
Mod
elin
g In
add
ition
to th
ese
stan
dard
repo
rts, t
he E
DM
S w
ill p
rodu
ce re
gion
al e
mis
sion
mod
el
(SM
OK
E)-
read
y em
issi
ons
inpu
t file
s fo
r the
regi
onal
vis
ibili
ty m
odel
ing
effo
rts.
Mee
ts re
quire
men
ts
3
GIS
/ M
appi
ng
The
WR
AP
ED
MS
sho
uld
incl
ude
a fu
lly fu
nctio
ning
GIS
mod
ule
that
pro
vide
s m
ultip
le to
ols
to d
ispl
ay d
ata
over
the
inte
rnet
. The
incl
usio
n of
a G
IS m
odul
e w
ill p
rovi
de a
mea
ns fo
r use
rs to
sel
ect d
ata
that
is o
f im
porta
nce
to th
em a
nd d
ispl
ay th
e da
ta in
a fa
shio
n th
at is
eas
ily u
nder
stoo
d.
Mee
ts m
inim
um re
quire
men
ts fo
r a m
appi
ng
syst
em b
ut n
ot a
true
GIS
sys
tem
. 3
The
WR
AP
ED
MS
sho
uld
incl
ude
the
follo
win
g G
IS fu
nctio
nalit
y: p
an, z
oom
, que
ry la
yer i
nfor
mat
ion,
abi
lity
to
add/
rem
ove
mul
tiple
laye
rs o
f dat
a, p
oint
and
clic
k, m
easu
re d
ista
nces
, buf
fer,
prin
t mul
tiple
siz
es o
f map
s, a
nd
sele
ct m
ap fe
atur
es b
y lin
e, re
ctan
gle,
or p
olyg
on.
Mee
ts m
inim
um re
quire
men
ts.
3
The
WR
AP
ED
MS
GIS
mod
ule
shou
ld in
clud
e th
e fo
llow
ing
laye
rs o
f dat
a: c
ount
y, s
tate
and
cou
ntry
pol
ygon
s,
triba
l res
erva
tion
poly
gons
, roa
dway
s an
d ra
ilroa
d lin
e fe
atur
es, C
AC
pol
ygon
s, in
tern
atio
nal p
olyg
ons,
m
etro
polit
an s
tatis
tical
are
as p
olyg
ons,
non
-atta
inm
ent a
rea
poly
gons
, cla
ss I
area
s po
lygo
ns, b
odie
s of
wat
er
poly
gons
, cen
sus
data
pol
ygon
s, o
ther
fede
ral l
and
poly
gons
(i.e
. nat
iona
l par
ks, m
onum
ents
, for
est,
and
refu
ges)
, and
WR
AP
mod
elin
g do
mai
n gr
id s
yste
m.
Mee
ts m
inim
um re
quire
men
ts.
3
G
IS
It sh
ould
hav
e th
e ab
ility
to s
elec
t and
dis
play
em
issi
ons
sour
ces
and
asso
ciat
ed e
mis
sion
s da
ta b
y ge
ogra
phic
al a
rea.
M
eets
min
imum
requ
irem
ents
. 3
A-6
* So
urce
doc
umen
ts:
1.
“Em
issi
ons D
ata
Man
agem
ent S
yste
m D
esig
n A
s Del
iver
ed F
inal
Rep
ort”
pre
pare
d by
E.H
. Pec
han,
Aug
ust 2
006.
2.
“E
DM
S Sc
ope
of W
ork
Dra
ft 3”
pre
pare
d by
E.H
. Pec
han,
dat
e un
know
n.
3.
“Fin
al N
eeds
Ass
essm
ent F
or E
valu
atio
n A
nd D
esig
n O
f An
Emis
sion
s Dat
a R
epor
ting,
Man
agem
ent,
And
Tra
ckin
g Sy
stem
” pr
epar
ed b
y EA
Eng
inee
ring,
Sc
ienc
e, a
nd T
echn
olog
y, Ju
ly 2
003.
A-7
Figu
re A
.1. D
atab
ase
Sche
mas
.
Sum
mar
y ta
bles
use
d by
for r
epor
ting
func
tions
by
the
web
inte
rface
SV_A
DH
OC
_QU
ERY_
FIR
ESV
_RPT
_AD
HO
C_Q
UER
Y_BI
OG
ENIC
SV_R
PT_A
DH
OC
_QU
ERY_
MO
BILE
SV_R
PT_A
DH
OC
_QU
ERY_
NO
NR
OAD
SV_R
PT_A
DH
OC
_QU
ERY_
POIN
TSV
_RPT
_AD
HO
C_Q
UER
Y_W
DU
ST
SV
_RP
T_C
AC1
SV
_RP
T_C
AC2
SV_R
PT_F
IRE1
SV
_RP
T_G
IS1
SV_R
PT_M
1SV
_RPT
_M1_
SCC
BDS
V_R
PT_
PTS
O21
SV_R
PT_
SR1
SV
_RP
T_S
R10
SV
_RP
T_S
R11
SV_R
PT_S
R11
_SC
CBD
SV
_RP
T_S
R13
SV
_RP
T_S
R14
SV_R
PT_
SR2
SV_R
PT_
SR3
SV_R
PT_S
R3_
SCC
BDSV
_RP
T_SR
4S
V_R
PT_
SR
4_S
BB
CD
SV_R
PT_S
R8_
SCC
BDSV
_RP
T_SR
9SV
_RPT
_SR
9_SC
CBD
SV_T
EMP_
RPT
_SR
ASV
_TEM
P_R
PT_S
RY
SV
__A
DH
OC
_QU
ER
Y_A
RE
A
EDM
S_T
XR
EDM
S_TX
NED
MS
_STG
EDM
S_PR
D
Each
sch
ema
cont
ains
this
set
of t
able
s:AC
TIVI
TY_A
TTR
IBU
TE_V
ALU
EAC
TIVI
TY_D
ETAI
LAC
TIVI
TY_F
IRE_
DE
TAIL
ACTI
VITY
_GEO
GR
APH
IC_D
ETAI
LAC
TIVI
TY_M
ETEO
RO
LOG
ICAL
_DET
AIL
ACTI
VITY
_PER
MIT
AR
EA
_EP
AR
EA
_PE
AR
EA
_EM
AREA
_CE
BIO
GEN
IC_E
MO
NR
OAD
_PE
ON
RO
AD_E
MPO
INT_
SIPO
INT_
EUPO
INT_
ERPO
INT_
EPPO
INT_
PEPO
INT_
EMPO
INT_
CE
TRDat
a in
serte
d fro
mN
IF M
DB
tabl
eIm
med
iate
ly lo
aded
from
TXR
tabl
es
Initi
al Q
A P
roce
ss
DB
A in
itiat
ed lo
adfro
m T
XN ta
bles
EDM
S_T
XR_A
UD
IT
EDM
S_T
XN_A
UD
IT
EDM
S_ST
G_A
UD
IT
EDM
S_PR
D_A
UD
IT
Each
sch
ema
cont
ains
this
set
of t
able
s,as
soci
ated
inde
xes,
trig
gers
, and
seq
uenc
es. A
tota
l of 8
4 ob
ject
s pe
r sch
ema.
All
tabl
es a
reem
pty.
ACTI
VITY
_ATT
RIB
UTE
_VAL
UE
ACTI
VITY
_DET
AIL
ACTI
VITY
_FIR
E_D
ETA
ILAC
TIVI
TY_G
EOG
RAP
HIC
_DET
AIL
ACTI
VITY
_MET
EOR
OLO
GIC
AL_D
ETAI
LAC
TIVI
TY_P
ERM
ITAR
EA_C
EA
RE
A_E
MA
RE
A_E
PA
RE
A_P
EB
IOG
EN
IC_E
MO
NR
OAD
_EM
ON
RO
AD
_PE
POIN
T_C
EPO
INT_
EMPO
INT_
EPPO
INT_
ER
POIN
T_E
UPO
INT_
PEP
OIN
T_S
ITR
DB
A in
itiat
ed d
elet
eat
som
e po
int (
noso
urce
cod
e, n
odo
cum
enta
tion)
DB
A in
itiat
ed lo
adfro
m T
XN
tabl
es
Dat
a up
date
s
DB
A in
spec
tion/
erro
rfix
es
Dat
a
Proc
ess
A-8
Figu
re A
-1. D
atab
ase
Sche
mas
(con
tinue
d).
EDM
S_R
EF
Look
up a
nd o
ther
refe
renc
e ta
bles
:AC
TIV
ITY
_ATT
RIB
UTE
S A
CTI
VIT
Y_C
ATE
GO
RY
AC
TIV
ITY_
TYPE
AFF
ILIA
TIO
N_T
YPE
CAC
CA
C_B
OU
ND
ARY
CO
NFI
DE
NTI
ALI
TY_I
ND
ICA
TOR
S C
ON
TAC
T_TY
PES
CO
NTR
OL_
DEV
ICE
_TY
PES
CO
NTR
OL_
EFF
ICIE
NC
Y_M
ETH
OD
S C
ON
TRO
L_ST
ATU
SES
CO
OR
DIN
ATE
_DA
TA_S
OU
RC
E_C
OD
E C
OU
NTR
IES
CO
UN
TY_B
OU
ND
ARY
CO
UN
TY_F
IPS
ELE
CTR
ON
IC_A
DD
RES
S_T
YPE_
NA
ME
EM
IS_R
ELE
ASE
_PO
INT_
TYPE
S E
MIS
SIO
N_E
ST_
ME
THO
DS
EM
ISS
ION
_TY
PES
EM
ISS
ION
_UN
IT_T
YPES
FAC
ILIT
Y_C
ATEG
OR
IES
FAC
TOR
FAC
TOR
_CA
LC_M
ETH
OD
S F
ACTO
R_S
OU
RC
E F
AC
TOR
_TYP
E F
AC
TOR
_TY
PES
FAC
TOR
_VAL
UES
HA
P_E
MIS
SIO
N_P
ERFO
RM
ANC
E_L
EVE
L H
OR
IZO
NTA
L_C
OLL
ECTI
ON
_ME
THO
DS
HO
RIZ
ON
TAL_
REF
ERE
NC
E_D
ATU
M_C
OD
INV
ALID
_UN
IT_M
AP
MA
CT
MA
CT_
CO
MP
LIA
NC
E_S
TATU
S M
ATE
RIA
L_IO
MA
TER
IALS
MAX
_EM
ISSI
ON
_RAT
E N
AIC
S P
LAN
_TAB
LE P
OLL
UTA
NT_
CA
TEG
OR
IES
PO
LLU
TAN
T_C
ATE
GO
RY
PO
LLU
TAN
TS Q
A_E
RR
OR
S R
EFE
REN
CE_
PO
INT_
CO
DE
REL
IAB
ILIT
Y_I
ND
ICAT
OR
S R
ULE
_EFF
EC
T_M
ETH
OD
S S
CC
SC
C_C
ATE
GO
RIE
S S
CC
_CA
TEG
OR
Y S
CC
_CA
TEG
OR
Y_TY
PE
SC
C_S
TAC
K_P
ARA
MS
_XTA
B_A
CTI
VE S
CC
_TIE
R S
EVE
RIT
Y_C
OD
E S
IC S
IC_S
TAC
K_P
ARA
MS
_XTA
B_A
CTI
VE S
OU
RC
E_T
YPE
S S
TATE
_CO
UN
TY_F
IPS
_QAQ
C S
TATE
_FIP
S T
AFF
TE
LEP
HO
NE_
NU
MB
ER_T
YPE
_NAM
E T
IER
TR
ANSA
CTI
ON
_TYP
ES T
RAN
SM
ITTA
L_IN
VEN
TOR
Y_TY
PES
TR
IBAL
_CO
DE
TR
IBAL
_DA
TA_C
OV
ERA
GE
TR
IBES
_CO
UN
TIE
S U
NIT
S W
EATH
ER_C
ON
DIT
ION
S X
Y_C
OO
RD
_TYP
ES Z
IPC
OD
ES9
9
ED
MS_
AP
P
Web
-inte
rface
rela
ted
tabl
es:
CO
NTA
CT_
INFO
DO
CU
ME
NTS
EMAI
L_D
ETA
ILS
EMAI
L_TE
XTEV
ENTS
EV
EN
TS_U
PLO
ADEX
POR
T_EM
AIL_
TEXT
FAQ
INVE
NTO
RY
INVE
NTO
RY_
TYP
EIN
VEN
TOR
Y_YE
AR
LIN
KSLO
GLO
G_D
ETA
ILS
MEM
BER
SM
OD
ELLI
NG
_CR
ETAR
IAM
OD
ELLI
NG
_CR
ETA
RIA
_OR
IGIN
ALN
AIC
S_C
ATEG
OR
YN
OTE
OR
GAN
IZA
TIO
NPO
LIC
Y_TE
RM
REG
ION
SR
EPO
RT_
CO
NTA
CT_
INFO
SEC
TOR
SNAP
SHO
T_D
OW
NLO
ADSU
BMIT
ED_D
ATA
TRAN
SFER
_FIL
EW
HAT
_IS_
EDM
S W
RAP
_PO
LIC
Y_TE
RM
A-9
Figure A-2. Area Emission Source Tables from the Pechan Data Model. Although fields exist to contrive
foreign keys (for example TR_PRIMARY_KEY in AREA_EP to create a one to many relationship from TR to AREA_EP) all such fields contain only null values. The same is true for the other emission source types (BIOGENIC, POINT, ONROAD).
A-10
Figure A-3. Activity Detail from the Pechan Data Model. None of these tables contain any rows.
A-11
Figure A-4. Inventory Tables from the Pechan Data Model. Although the foreign key constraints do not exist, it is possible to create them.
A-12
Figure A-5. Logging Tables from the Pechan Data Model.
Notes: EDMS_APP.LOG to EDMS_REF.QA_ERRORS – can’t create foreign key because EDMS_APP.LOG.ERROR_CODE contains 0 for all rows. EDMS_REF.QA_ERRORS does not contain a row where ERROR_CODE = 0. EDMS_APP.LOG_DETAILS to EDMS_APP.LOG – can’t create foreign key because some parent keys (LOG_ID) cannot be found. EDMS_APP.INVENTORY, EDMS_APP.LOG, EDMS_APP.NOTE to EDMS_APP.ORGANIZATION – able to create foreign keys (ORGANIZATION contains only one row) EDMS_APP.NOTE to EDMS_APP.INVENTORY – able to create foreign key.
A-13
Figure A-6. Security Tables from the Pechan Data Model.
Note: The EDMS_USER, USER_ROLE, USER_SECURITY, and USER_ORGANIZATION tables exist but are empty. A table named MEMBERS, not included in this diagram but which contains columns similar to EDMS_USER, actually holds the registered user information. It does not relate to any other tables.
A-14
Tabl
e A
-3. I
nven
tory
Ver
sion
Des
crip
tion
Inve
ntor
y ID
Inve
ntor
y D
escr
iptio
nC
omm
ents
1EP
A Pr
elim
inar
y (2
002)
Uno
ffici
al v
ersi
on o
f the
EPA
200
2 Pr
elim
ary
inve
ntor
y. I
t was
obt
aine
d fr
om th
e EP
A.
2Ac
tual
Ver
sion
1.0
Poin
t Sou
rce
Are
a So
urce
Ala
ska
Upd
ated
Inve
ntor
y fro
m D
ata
Prov
ider
EPA
2002
Pre
limin
ary
load
ed (g
ap-fi
lled)
Ariz
ona
CER
R d
ata
via
EPA
EPA
2002
Pre
limin
ary
load
ed (g
ap-fi
lled)
Ariz
ona
Mar
icop
aU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rC
alifo
rnia
CER
R d
ata
via
EPA
CER
R d
ata
via
EPA
Col
orad
oC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AId
aho
CER
R d
ata
via
EPA
CER
R d
ata
via
EPA
Mon
tana
CER
R d
ata
via
EPA
EPA
2002
Pre
limin
ary
load
ed (g
ap-fi
lled)
Nev
ada
CER
R d
ata
via
EPA
EPA
2002
Pre
limin
ary
load
ed (g
ap-fi
lled)
Nev
ada
Cla
rk C
oU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rN
evad
a W
asho
e C
oU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rN
ew M
exic
oC
ERR
dat
a vi
a EP
AEP
A 20
02 P
relim
inar
y lo
aded
(gap
-fille
d)N
ew M
exic
o Be
rnal
illo C
oU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
CE
RR
dat
a vi
a E
PA
Nor
th D
akot
aC
ERR
dat
a vi
a EP
AEP
A 20
02 P
relim
inar
y lo
aded
(gap
-fille
d)O
rego
nC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AO
rego
n La
ne C
ount
yC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AS
outh
Dak
ota
CER
R d
ata
via
EPA
EPA
2002
Pre
limin
ary
load
ed (g
ap-fi
lled)
Uta
hC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AW
ashi
ngto
nU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
CE
RR
dat
a vi
a E
PA
Was
hing
ton
Puge
t Sou
ndC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AW
ashi
ngto
n O
lym
pic
CER
R d
ata
via
EPA
CER
R d
ata
via
EPA
Wyo
min
gU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rTr
ibal
Rev
ised
dat
a re
ceiv
ed, p
oten
tial o
verla
ps u
nder
ana
lysi
sFo
rt Pe
ck d
ata
repo
rted,
ove
rlap
anal
ysis
pen
ding
. La
Post
a An
alys
is p
endi
ngO
ther
Sec
tors
Bio
geni
c - D
ata
load
ed fr
om R
egio
nal M
odel
ing
Cen
ter r
esul
ts.
Fire
- M
odel
ed d
ata
to b
e lo
aded
into
futu
re in
vent
ory
vers
ion.
Som
e da
ta p
rovi
ders
pro
vide
d fir
e da
ta in
are
a so
urce
sub
mitt
als.
Win
d-bl
own
Dus
t - M
odel
ed d
ata
into
be
load
ed to
futu
re in
vent
ory
vers
ion.
3EP
A Ve
rsio
n 3
(200
1)
5Tr
aini
ngTh
is in
vent
ory
cont
ains
dat
a of
unc
erta
in a
nd/o
r fic
titio
us o
rigin
and
is m
eant
onl
y fo
r tra
inin
g pu
rpos
es.
Uno
ffici
al v
ersi
on o
f the
EPA
200
1 Ve
rsio
n 3
inve
ntor
y. I
t was
obt
aine
d fr
om th
e EP
A.
Non
-Roa
d M
obile
- D
ata
gap-
fille
d fro
m 2
002
EP
A P
relim
inar
y In
vent
ory
On-
Roa
d M
obile
- D
ata
gap-
fille
d fro
m 2
002
EPA
Prel
imin
ary
Inve
ntor
y
A-15
Tabl
e A
-3. I
nven
tory
Ver
sion
Des
crip
tion
(con
tinue
d)
Inve
ntor
y ID
Inve
ntor
y D
escr
iptio
nC
omm
ents
6Ac
tual
Ver
sion
0.9
(200
2)Th
is in
vent
ory
repr
esen
ts o
nly
data
that
was
sub
mitt
ed a
nd in
clud
es n
o ga
p-fil
led
info
rmat
ion.
Poi
nt S
ourc
eA
rea
Sou
rce
Ala
ska
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rA
rizon
aC
ER
R d
ata
via
EP
AA
rizon
a M
aric
opa
Upd
ated
Inve
ntor
y fro
m D
ata
Prov
ider
Upd
ated
Inve
ntor
y fro
m D
ata
Prov
ider
Cal
iforn
iaC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AC
olor
ado
CER
R d
ata
via
EPA
CER
R d
ata
via
EPA
Idah
oC
ER
R d
ata
via
EP
AC
ER
R d
ata
via
EP
AM
onta
naC
ER
R d
ata
via
EP
AN
evad
aC
ERR
dat
a vi
a EP
AN
evad
a C
lark
Co
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
Nev
ada
Was
hoe
Co
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
New
Mex
ico
CER
R d
ata
via
EPA
New
Mex
ico
Ber
nalill
o C
oU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
CE
RR
dat
a vi
a E
PA
Nor
th D
akot
aC
ER
R d
ata
via
EP
AO
rego
nC
ER
R d
ata
via
EP
AC
ER
R d
ata
via
EP
AO
rego
n La
ne C
ount
yC
ER
R d
ata
via
EP
AC
ER
R d
ata
via
EP
AS
outh
Dak
ota
CE
RR
dat
a vi
a E
PA
Uta
hC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AW
ashi
ngto
nU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
CE
RR
dat
a vi
a E
PA
Was
hing
ton
Puge
t Sou
ndC
ER
R d
ata
via
EP
AC
ER
R d
ata
via
EP
AW
ashi
ngto
n O
lym
pic
CE
RR
dat
a vi
a E
PA
CE
RR
dat
a vi
a E
PA
Wyo
min
gU
pdat
ed In
vent
ory
from
Dat
a Pr
ovid
erU
pdat
ed In
vent
ory
from
Dat
a Pr
ovid
erTr
ibal
Rev
ised
dat
a re
ceiv
ed, p
oten
tial o
verla
ps u
nder
ana
lysi
sR
evis
ed d
ata
rece
ived
, pot
entia
l ove
rlaps
und
er a
naly
sis
Oth
er S
ecto
rsB
ioge
nic
- Dat
a lo
aded
from
Reg
iona
l Mod
elin
g C
ente
r res
ults
.Fi
re, N
on-R
oad
- som
e A
rea
subm
ittal
s in
clud
ed e
mis
sion
s fro
m th
ese
sect
ors,
and
they
hav
e be
en in
clud
ed.
7Ac
tual
Ver
sion
1.1
(200
2)Po
int S
ourc
eA
rea
Sour
ceA
lask
aU
pdat
ed In
vent
ory
from
Dat
a Pr
ovid
erEP
A 20
02 P
relim
inar
y lo
aded
(gap
-fille
d)Ar
izon
aC
ERR
dat
a vi
a EP
AEP
A 20
02 P
relim
inar
y lo
aded
(gap
-fille
d)Ar
izon
a M
aric
opa
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
Cal
iforn
iaC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AC
olor
ado
CER
R d
ata
via
EPA
CER
R d
ata
via
EPA
Idah
oC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AM
onta
naC
ERR
dat
a vi
a EP
AEP
A 20
02 P
relim
inar
y lo
aded
(gap
-fille
d)N
evad
aC
ERR
dat
a vi
a EP
AEP
A 20
02 P
relim
inar
y lo
aded
(gap
-fille
d)
A-16
Tabl
e A
-3. I
nven
tory
Ver
sion
Des
crip
tion
(con
tinue
d)
Inve
ntor
y ID
Inve
ntor
y D
escr
iptio
nC
omm
ents
7Ac
tual
Ver
sion
1.1
(200
2)Po
int S
ourc
eA
rea
Sour
ceN
evad
a C
lark
Co
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
Nev
ada
Was
hoe
Co
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
New
Mex
ico
CER
R d
ata
via
EPA
EPA
2002
Pre
limin
ary
load
ed (g
ap-fi
lled)
New
Mex
ico
Bern
alillo
Co
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rC
ER
R d
ata
via
EP
AN
orth
Dak
ota
CER
R d
ata
via
EPA
EPA
2002
Pre
limin
ary
load
ed (g
ap-fi
lled)
Ore
gon
CER
R d
ata
via
EPA
CER
R d
ata
via
EPA
Ore
gon
Lane
Cou
nty
CER
R d
ata
via
EPA
CER
R d
ata
via
EPA
Sou
th D
akot
aC
ERR
dat
a vi
a EP
AEP
A 20
02 P
relim
inar
y lo
aded
(gap
-fille
d)U
tah
CER
R d
ata
via
EPA
CER
R d
ata
via
EPA
Was
hing
ton
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rC
ER
R d
ata
via
EP
AW
ashi
ngto
n Pu
get S
ound
CER
R d
ata
via
EPA
CER
R d
ata
via
EPA
Was
hing
ton
Oly
mpi
cC
ERR
dat
a vi
a EP
AC
ERR
dat
a vi
a EP
AW
yom
ing
Upd
ated
Inve
ntor
y fro
m D
ata
Pro
vide
rU
pdat
ed In
vent
ory
from
Dat
a P
rovi
der
Trib
alR
evis
ed d
ata
rece
ived
, pot
entia
l ove
rlaps
und
er a
naly
sis
Rev
ised
dat
a re
ceiv
ed, p
oten
tial o
verla
ps u
nder
ana
lysi
s
Oth
er S
ecto
rsN
on-R
oad
Mob
ile -
Dat
a lo
aded
from
Mod
elin
g in
itiat
ive,
exc
eptio
n: C
A - l
ocom
otiv
e, c
omm
eric
al m
arin
e an
d ai
rcra
ft w
ere
mod
eled
, oth
erw
ise
gap-
fille
d fro
m E
PA 2
002
prel
imin
ary
On-
road
Mob
ile -
Dat
a ga
p-fil
led
from
200
2 EP
A Pr
elim
inar
y In
vent
ory
Bio
geni
c - D
ata
load
ed fr
om R
egio
nal M
odel
ing
Cen
ter r
esul
ts.
Fire
- M
odel
ed d
ata
to b
e lo
aded
into
futu
re in
vent
ory
vers
ion.
Som
e da
ta p
rovi
ders
pro
vide
d fir
e da
ta in
are
a so
urce
sub
mitt
als.
Win
d-bl
own
Dus
t - M
odel
ed d
ata
into
be
load
ed to
futu
re in
vent
ory
vers
ion.
Cor
rect
ions
/Add
ition
s fo
r Inv
ento
ry 7
Cor
tina
Trib
e A
rea
sour
ce d
ata
has
been
add
edR
evis
ed A
rea
and
Poi
nt s
ourc
e da
ta w
as p
rovi
ded
by W
yom
ing
Rev
ised
Poi
nt s
ourc
e da
ta w
as p
rovi
ded
by N
evad
aPo
int s
ourc
e da
ta w
as a
dded
for t
he fo
llow
ing
tribe
s: C
abaz
on, F
ort M
ojav
e, F
ort P
eck,
and
Sho
shon
e/Ba
nnoc
k
8Ac
tual
Ver
sion
1.2
Sect
o rD
ata
Prov
ider
Poin
t
Non
-Fire
Age
ncy
Dat
a re
view
ed a
nd s
ubm
itted
by
ER
G
Fire
Inve
ntor
y pr
epar
ed b
y A
ir S
cien
ces
Are
a
Non
Oil
and
Gas
Agen
cy D
ata
revi
ewed
and
sub
mitt
ed b
y E
RG
O
il an
d G
asIn
vent
ory
prep
ared
by
ER
GN
on-r
oad
Mob
ileIn
vent
ory
prep
ared
by
EN
VIR
ON
On-
Roa
d M
obile
Inve
ntor
y pr
epar
ed b
y E
NVI
RO
NB
ioge
nic
Inve
ntor
y m
odel
ed b
y th
e R
egio
nal M
odel
ing
Cen
ter
Extra
are
a so
urce
reco
rds
(from
the
gap-
fillin
g pr
oces
s) a
ttrib
uted
to C
lark
and
Was
hoe
Cou
ntie
s, N
V, h
ave
been
rem
oved
.
A-17
Tabl
e A
-4. O
lder
Inve
ntor
y C
heck
list (
Poin
t Sou
rce
Emis
sion
s)
EP
A P
relim
inar
y (2
002)
Actu
al V
ersi
on 1
.0EP
A Ve
rsio
n 3
(200
1)Tr
aini
ngAc
tual
Ver
sion
0.9
Actu
al V
ersi
on 1
.1A
ctua
l Ver
sion
1.2
FIPS
Cod
eSt
ate/
Trib
al N
ame
Inve
ntor
y 1
Inve
ntor
y 2
Inve
ntor
y 3
Inve
ntor
y 5
Inve
ntor
y 6
Inve
ntor
y 7
Inve
ntor
y 8
02A
lask
a04
Ariz
ona
06C
alifo
rnia
08C
olor
ado
16Id
aho
30M
onta
na32
Nev
ada
35N
ew M
exic
o38
Nor
th D
akot
a41
Ore
gon
46S
outh
Dak
ota
49U
tah
53W
ashi
ngto
n56
Wyo
min
g
101
Con
fede
rate
d Tr
ibes
of t
he C
olvi
lle R
eser
vatio
n,
WA
124
Con
fede
rate
d Tr
ibes
and
Ban
ds o
f the
Yak
ama
Nat
ion,
WA
143
Con
fede
rate
d Tr
ibes
of t
he U
mat
illa
Res
erva
tion,
OR
180
Sho
shon
e-B
anno
ck T
ribes
of t
he F
ort H
all
Res
erva
tion,
ID
181
Coe
ur D
'Ale
ne T
ribe
of th
e C
oeur
D'A
lene
R
eser
vatio
n, ID
182
Nez
Per
ce T
ribe,
ID20
2C
row
Trib
e, M
T
203
Con
fede
rate
d Sa
lish
and
Koot
enai
Trib
es, M
T
206
Ass
inib
oine
and
Sio
ux T
ribes
of t
he F
ort P
eck
Indi
an R
eser
vatio
n, M
T20
7N
orth
ern
Che
yenn
e, M
T
281
Ara
paho
e Tr
ibe
of th
e W
ind
Riv
er R
eser
vatio
n,
WY
303
Spi
rit L
ake
Trib
e, N
D
568
Cab
azon
Ban
d of
the
Cha
uilla
Mis
sion
Indi
ans
of th
e C
abaz
on R
eser
vatio
n, C
A
577
La P
osta
Ban
d of
Die
guen
o M
issi
on In
dian
s of
th
e La
Pos
ta In
dian
Res
erva
tion,
CA
604
Fort
Moj
ave
Indi
an T
ribe
of A
Z, C
A &
NV
610
Toho
no O
'Odh
am N
atio
n, A
Z
614
Gila
Riv
er In
dian
Com
mun
ity o
f the
Gila
Riv
er
Indi
an R
eser
vatio
n, A
Z
615
Sal
t Riv
er P
ima-
Mar
icop
a In
dian
Com
mun
ity o
f th
e S
alt R
iver
Res
erva
tion,
AZ
707
Pue
blo
of L
agun
a, N
M71
5P
uebl
o of
San
ta A
na, N
M
751
Ute
Mou
ntai
n Tr
ibe
of th
e U
te M
ount
ain
Res
erva
tion,
CO
, NM
& U
T78
0N
avaj
o N
atio
n, A
Z, N
M &
UT
750
Sou
ther
n U
tes
Dat
a In
vent
ory
A-18
Ta
ble
A-5
. Old
er In
vent
ory
Che
cklis
t (A
rea
Sour
ce E
mis
sion
s)
EP
A Pr
elim
inar
y (2
002)
Actu
al V
ersi
on 1
.0EP
A Ve
rsio
n 3
(200
1)Tr
aini
ngAc
tual
Ver
sion
0.9
Actu
al V
ersi
on 1
.1Ac
tual
Ver
sion
1.2
FIPS
Cod
eSt
ate/
Trib
al N
ame
Inve
ntor
y 1
Inve
ntor
y 2
Inve
ntor
y 3
Inve
ntor
y 5
Inve
ntor
y 6
Inve
ntor
y 7
Inve
ntor
y 8
02Al
aska
04Ar
izon
a06
Cal
iforn
ia08
Col
orad
o16
Idah
o30
Mon
tana
32N
evad
a35
New
Mex
ico
38N
orth
Dak
ota
41O
rego
n46
Sout
h D
akot
a49
Uta
h53
Was
hing
ton
56W
yom
ing
143
Con
fede
rate
d Tr
ibes
of t
he U
mat
illa
Res
erva
tion,
OR
182
Nez
Per
ce T
ribe,
ID20
2C
row
Trib
e, M
T20
4Fo
rt Be
lkna
p, M
T
206
Assi
nibo
ine
and
Siou
x Tr
ibes
of t
he F
ort
Peck
Indi
an R
eser
vatio
n, M
T20
7N
orth
ern
Che
yenn
e, M
T
281
Arap
ahoe
Trib
e of
the
Win
d R
iver
R
eser
vatio
n, W
Y30
3Sp
irit L
ake
Trib
e, N
D51
3C
ortin
a R
anch
eria
549
Bish
op P
aiut
e Tr
ibe
577
La P
osta
Ban
d of
Die
guen
o M
issi
on
Indi
ans
of th
e La
Pos
ta In
dian
R
eser
vatio
n, C
A
585
Paum
a-Yu
ima
Band
of L
uise
no M
issi
on
Indi
ans
614
Gila
Riv
er In
dian
Com
mun
ity o
f the
Gila
R
iver
Indi
an R
eser
vatio
n, A
Z
615
Salt
Riv
er P
ima-
Mar
icop
a In
dian
C
omm
unity
of t
he S
alt R
iver
R
eser
vatio
n, A
Z
624
Paiu
te-S
hosh
one
of th
e Lo
ne P
ine
Com
mun
ity70
3Pu
eblo
of A
com
a70
7Pu
eblo
of L
agun
a, N
M71
5Pu
eblo
of S
anta
Ana
, NM
751
Ute
Mou
ntai
n Tr
ibe
of th
e U
te M
ount
ain
Res
erva
tion,
CO
, NM
& U
T78
0N
avaj
o N
atio
n, A
Z, N
M &
UT
750
Sout
hern
Ute
s40
5Fo
nd d
u La
c Tr
ibe
(MN
)
A-19
Ta
ble
A-6
. Old
er In
vent
ory
Che
cklis
t (B
ioge
nics
)
EPA
Prel
imin
ary
(200
2)Ac
tual
Ver
sion
1.0
EPA
Vers
ion
3 (2
001)
Trai
ning
Actu
al V
ersi
on 0
.9Ac
tual
Ver
sion
1.1
Actu
al V
ersi
on 1
.2FI
PS C
ode
Stat
e/Tr
ibal
Nam
eIn
vent
ory
1In
vent
ory
2In
vent
ory
3In
vent
ory
5In
vent
ory
6In
vent
ory
7In
vent
ory
802
Alas
ka04
Ariz
ona
06C
alifo
rnia
08C
olor
ado
16Id
aho
30M
onta
na32
Nev
ada
35N
ew M
exic
o38
Nor
th D
akot
a41
Ore
gon
46So
uth
Dak
ota
49U
tah
53W
ashi
ngto
n56
Wyo
min
g
Ta
ble
A-7
. Old
er In
vent
ory
Che
cklis
t (O
n-R
oad
Mob
ile E
mis
sion
s)
EP
A P
relim
inar
y (2
002)
Act
ual V
ersi
on 1
.0EP
A Ve
rsio
n 3
(200
1)Tr
aini
ngAc
tual
Ver
sion
0.9
Actu
al V
ersi
on 1
.1Ac
tual
Ver
sion
1.2
FIPS
Cod
eSt
ate/
Trib
al N
ame
Inve
ntor
y 1
Inve
ntor
y 2
Inve
ntor
y 3
Inve
ntor
y 5
Inve
ntor
y 6
Inve
ntor
y 7
Inve
ntor
y 8
02A
lask
a04
Ariz
ona
06C
alifo
rnia
08C
olor
ado
16Id
aho
30M
onta
na32
Nev
ada
35N
ew M
exic
o38
Nor
th D
akot
a41
Ore
gon
46S
outh
Dak
ota
49U
tah
53W
ashi
ngto
n56
Wyo
min
g
A-20
Ta
ble
A-8
. Old
er In
vent
ory
Che
cklis
t (N
on-R
oad
Mob
ile E
mis
sion
s)
EP
A Pr
elim
inar
y (2
002)
Actu
al V
ersi
on 1
.0EP
A Ve
rsio
n 3
(200
1)Tr
aini
ngAc
tual
Ver
sion
0.9
Actu
al V
ersi
on 1
.1Ac
tual
Ver
sion
1.2
FIPS
Cod
eSt
ate/
Trib
al N
ame
Inve
ntor
y 1
Inve
ntor
y 2
Inve
ntor
y 3
Inve
ntor
y 5
Inve
ntor
y 6
Inve
ntor
y 7
Inve
ntor
y 8
02Al
aska
04A
rizon
a06
Cal
iforn
ia08
Col
orad
o16
Idah
o30
Mon
tana
32N
evad
a35
New
Mex
ico
38N
orth
Dak
ota
41O
rego
n46
Sout
h D
akot
a49
Uta
h53
Was
hing
ton
56W
yom
ing
A-21
Tabl
e A
-9.
Inve
ntor
y 9
Che
cklis
t (Po
int S
ourc
e Em
issi
ons)
Prod
uctio
n Ta
bles
FIPS
Cod
eSt
ate/
Trib
al N
ame
Dat
a co
mpl
ete
and
corr
ect
for I
nvID
9 -
2002
Fin
al V
-2.0
File
for m
issi
ng/u
pdat
ed d
ata
02Al
aska
04A
rizon
a06
Cal
iforn
ia08
Col
orad
o16
Idah
o30
Mon
tana
32N
evad
a35
New
Mex
ico
38N
orth
Dak
ota
41O
rego
n46
Sou
th D
akot
a49
Uta
h53
Was
hing
ton
revi
sion
s no
t inc
orpo
rate
dC
ompi
led
WR
AP In
vent
ory
Poi
nt -
NIF
_FIN
.zip
56W
yom
ing
101
Con
fede
rate
d Tr
ibes
of t
he C
olvi
lle R
eser
vatio
n, W
A12
4C
onfe
dera
ted
Trib
es a
nd B
ands
of t
he Y
akam
a N
atio
n, W
A14
3C
onfe
dera
ted
Trib
es o
f the
Um
atilla
Res
erva
tion,
OR
180
Sho
shon
e-Ba
nnoc
k Tr
ibes
of t
he F
ort H
all R
eser
vatio
n, ID
181
Coe
ur D
'Ale
ne T
ribe
of th
e C
oeur
D'A
lene
Res
erva
tion,
ID18
2N
ez P
erce
Trib
e, ID
data
mis
sing
Nez
Per
ce.m
db20
2C
row
Trib
e, M
Tda
ta m
issi
ngC
row
Trib
e.m
db20
3C
onfe
dera
ted
Sal
ish
and
Koo
tena
i Trib
es, M
Tda
ta m
issi
ngR
esub
mis
sion
_Sal
ishK
oote
nai.m
db20
6A
ssin
iboi
ne a
nd S
ioux
Trib
es o
f the
For
t Pec
k In
dian
Res
erva
tion,
MT
207
Nor
ther
n C
heye
nne,
MT
data
mis
sing
Nor
ther
nChe
yenn
e.m
db28
1A
rapa
hoe
Trib
e of
the
Win
d R
iver
Res
erva
tion,
WY
303
Spiri
t Lak
e Tr
ibe,
ND
data
mis
sing
Spiri
tLak
eNat
ion.
mdb
568
Cab
azon
Ban
d of
the
Cha
uilla
Mis
sion
Indi
ans
of th
e C
abaz
on R
eser
vatio
n, C
A57
7La
Pos
ta B
and
of D
iegu
eno
Mis
sion
Indi
ans
of th
e La
Pos
ta In
dian
Res
erva
tion,
CA
604
Fort
Moj
ave
Indi
an T
ribe
of A
Z, C
A &
NV
610
Toho
no O
'Odh
am N
atio
n, A
Z61
4G
ila R
iver
Indi
an C
omm
unity
of t
he G
ila R
iver
Indi
an R
eser
vatio
n, A
Z61
5S
alt R
iver
Pim
a-M
aric
opa
Indi
an C
omm
unity
of t
he S
alt R
iver
Res
erva
tion,
AZ
revi
sion
s no
t inc
orpo
rate
dTr
ibal
Rev
isio
ns_F
IN.z
ip70
7P
uebl
o of
Lag
una,
NM
715
Pue
blo
of S
anta
Ana
, NM
751
Ute
Mou
ntai
n Tr
ibe
of th
e U
te M
ount
ain
Res
erva
tion,
CO
, NM
& U
T78
0N
avaj
o N
atio
n, A
Z, N
M &
UT
750
Sou
ther
n U
tes
data
mis
sing
triba
l lan
ds C
O p
lant
s w
ith e
mis
sion
s.xl
s
A-22
Tabl
e A
-10.
Inve
ntor
y 9
Che
cklis
t (A
rea
Sour
ce E
mis
sion
s)
Pr
oduc
tion
Tabl
esFI
PS C
ode
Stat
e/Tr
ibal
Nam
eD
ata
com
plet
e an
d co
rrec
tfo
r Inv
ID 9
- 20
02 F
inal
V-2
.0Fi
le fo
r mis
sing
/upd
ated
dat
a02
Alas
ka04
Ariz
ona
06C
alifo
rnia
08C
olor
ado
16Id
aho
30M
onta
na32
Nev
ada
35N
ew M
exic
o38
Nor
th D
akot
a41
Ore
gon
46So
uth
Dak
ota
49U
tah
53W
ashi
ngto
n56
Wyo
min
g14
3C
onfe
dera
ted
Trib
es o
f the
Um
atilla
Res
erva
tion,
OR
data
mis
sing
Res
ubm
issi
on_T
ribal
Non
Poin
t.mdb
182
Nez
Per
ce T
ribe,
IDda
ta m
issi
ngN
ezPe
rce.
mdb
202
Cro
w T
ribe,
MT
data
mis
sing
Cro
wTr
ibe.
mdb
204
Fort
Belk
nap,
MT
data
mis
sing
no d
ata
rece
ived
206
Assi
nibo
ine
and
Siou
x Tr
ibes
of t
he F
ort P
eck
Indi
an
Res
erva
tion,
MT
data
cor
rect
, SC
C's
231
0 &
2294
mis
sing
data
for m
issi
ng S
CC
's in
clud
ed in
Res
ubm
issi
on_T
ribal
Non
Poin
t.mdb
207
Nor
ther
n C
heye
nne,
MT
data
mis
sing
Nor
ther
nChe
yenn
e.m
db28
1Ar
apah
oe T
ribe
of th
e W
ind
Riv
er R
eser
vatio
n, W
Y30
3Sp
irit L
ake
Trib
e, N
Dda
ta m
issi
ngSp
iritL
akeN
atio
n.m
db51
3C
ortin
a R
anch
eria
549
Bish
op P
aiut
e Tr
ibe
data
mis
sing
Res
ubm
issi
on_T
ribal
Non
Poin
t.mdb
577
La P
osta
Ban
d of
Die
guen
o M
issi
on In
dian
s of
the
La P
osta
In
dian
Res
erva
tion,
CA
data
cor
rect
, SC
C's
240
1 &
2465
mis
sing
data
for m
issi
ng S
CC
's in
clud
ed in
Res
ubm
issi
on_T
ribal
Non
Poin
t.mdb
585
Paum
a-Yu
ima
Band
of L
uise
no M
issi
on In
dian
sda
ta m
issi
ngR
esub
mis
sion
_Trib
alN
onPo
int.m
db
614
Gila
Riv
er In
dian
Com
mun
ity o
f the
Gila
Riv
er In
dian
R
eser
vatio
n, A
Zda
ta m
issi
ngR
esub
mis
sion
_Trib
alN
onPo
int.m
db
615
Salt
Riv
er P
ima-
Mar
icop
a In
dian
Com
mun
ity o
f the
Sal
t Riv
er
Res
erva
tion,
AZ
data
mis
sing
Res
ubm
issi
on_T
ribal
Non
Poin
t.mdb
624
Paiu
te-S
hosh
one
of th
e Lo
ne P
ine
Com
mun
it yda
ta m
issi
ngR
esub
mis
sion
_Trib
alN
onPo
int.m
db70
3Pu
eblo
of A
com
ada
ta m
issi
ngR
esub
mis
sion
_Trib
alN
onPo
int.m
db70
7Pu
eblo
of L
agun
a, N
Mda
ta m
issi
ngR
esub
mis
sion
_Trib
alN
onPo
int.m
db71
5Pu
eblo
of S
anta
Ana
, NM
data
mis
sing
Res
ubm
issi
on_T
ribal
Non
Poin
t.mdb
751
Ute
Mou
ntai
n Tr
ibe
of th
e U
te M
ount
ain
Res
erva
tion,
CO
, NM
&
UT
data
cor
rect
, SC
C 2
310
data
mis
sing
data
for m
issi
ng S
CC
's in
clud
ed in
Res
ubm
issi
on_T
ribal
Non
Poin
t.mdb
780
Nav
ajo
Nat
ion,
AZ,
NM
& U
Tda
ta c
orre
ct, S
CC
210
3 da
ta m
issi
ngda
ta fo
r mis
sing
SC
C's
incl
uded
in N
avaj
oNat
ion_
Area
Com
mer
cial
Hea
ting.
mdb
750
Sout
hern
Ute
sda
ta m
issi
ngtri
bal l
ands
CO
pla
nts
with
em
issi
ons.
xls
A-23
Table A-11. Inventory 9 Checklist (Biogenics) Production Tables
FIPS Code State/Tribal Name Data complete and correct
for InvID 9 - 2002 Final V-2.002 Alaska04 Arizona06 California08 Colorado16 Idaho30 Montana32 Nevada35 New Mexico38 North Dakota41 Oregon46 South Dakota49 Utah53 Washington56 Wyoming
Table A-12. Inventory 9 Checklist (On-Road Mobile Emissions) Production Tables
FIPS Code State/Tribal Name Data complete and correct
for InvID 9 - 2002 Final V-2.002 Alaska04 Arizona06 California08 Colorado16 Idaho30 Montana32 Nevada35 New Mexico38 North Dakota41 Oregon46 South Dakota49 Utah53 Washington56 Wyoming
A-24
Table A-13. Inventory 9 Checklist (Non-Road Mobile Emissions) Production Tables
FIPS Code State/Tribal Name Data complete and correct
for InvID 9 - 2002 Final V-2.002 Alaska04 Arizona06 California08 Colorado16 Idaho30 Montana32 Nevada35 New Mexico38 North Dakota41 Oregon46 South Dakota49 Utah53 Washington56 Wyoming
A-25
Select rows from SUBMITTED_DATA WHERE FILE_TO_TXR_STATUS = 0
Open log file
For each row
write data to pipe delimited output line and write to log file
Trim(ObjData("TRANFER_JOB_ID")) & "|" &Trim(ObjData("INVENTORY_ID")) & "|" &Replace(UCase(Trim(ObjData("SECTOR_NAME"))), "AF", "P") & "|" &Trim(ObjData("UPLOAD_FOLDER_PTAH")) &"|" & Trim(ObjData("FILE_NAME")) & "|" &Trim(ObjData("UPDATED_DATE")) & "|" &Trim(ObjData("EMAIL")) & "|" &Trim(ObjData("NAME")) & "|" &Trim(ObjData("ORGANIZATION_ID"))
Close log file
Open log file
End for each row
Do while not EOF
Read line in log file
CallExecuteTransfer
With args placed in arraysplit from log file line
Datetimestamp _Bulk_Export.txt
End loop
RunAllPendingExports
EndRunAllPendingExports
ExecuteTransfer
CallFILE_TO_TXR
Return ok?
CallTXR_TO_TXN
Return ok?
CallTXN_MASTERDIAG
Return ok?
Nothing. Commented out line 'TXN To STG
Nothing. Commented outlines referring to error and
emailing uploader regardingthe error
yes
yes
yes
no
no
no
End ExecuteTransfer
EDMSUPLOAD.exe -Automated Data
Submittal Process
See page A-27
See page A-28
See page A-28
Figure A-7. Automated Data Submittal Process
A-26
FILE_TO_TXR
Open log file Tranfer_Job_ID_UploadTool_Log.txt
Call UnZipUploadedFile
Return ok?
Read MS AccessFile Name
Unzippedfile
yes
File name read ok?
Write errormessage to logfileno
Write errormessage to logfile no
Call WriteUploadReutineRemarks
File other than MDBfound in zip file
Set TRANSFER_STARTED Flagin SBMITED_DATA Table for the
TRANFER_JOB_ID
yes
Connect to the MDB file (Jet Oledb)
Connection ok?
yes
no
Get Select SQL foreach expected
table for the sectorTBLPOINTTR, etc.
CASE SECTOR
POINT, P
Get list of tablesfrom MDB file
MDB has thecorrect tables?
no
CASE TABLENAME callsPOINT_INSERT_TABLENAME
(Example) CASE TBLPOINTTRCall POINT_INSERT_TBLPOINTTR
Errors and successes logged each step
yes
For Each MDB Table
For Each MDB Table Row
Follows same logic for other SECTORS:CASE "AREA", "A", "NONROAD MOBILE", "N"
CASE "ONROAD MOBILE", "M"
End For Each MDB Table Row
End For Each MDB Table
All rows for all tablesinserted w/out error?
Commit inserts toTXR tablesyesRollback inserts
from TXR tables no
End FILE_TO_TXR
End FILE_TO_TXRReturn error code set
Return error code set
EDMSUPLOAD.exe -Automated Data
Submittal Processcontinued
Figure A-7. Automated Data Submittal Process (continued).
A-27
TXR_TO_TXN
CASE SECT RO
CASEAREA, A, NONROAD MOBILE, N
CALL Stored Procedureproc_ETL_TXRtoTXN_Area
CASEPOINT, P
CALL Stored Procedureproc_ETL_TXRtoTXN_point
CASEONROAD MOBILE, M
CALL Stored Procedureproc_ETL_TXRtoTXN_Mobile
EDMSUPLOAD.exe -Automated Data
Submittal Processcontinued
Bulk Insert records to TXNtables from TXR
in tables
Return ok? Commit inserts toTXN tables
Rollback insertsfrom TXN tables
EndTXR_TO_TXN
Success/errors loggedeach step
TXN_MASTER IAGD
CASE SECT RO
CASEAREA, A, NONROAD MOBILE, N
CALL Stored ProcedurepA_MasterDiagnose
CASEPOINT, P
CALL Stored ProcedurepP_MasterDiagnose
CASEONROAD MOBILE, M
CALL Stored ProcedurepM_MasterDiagnose
Each calls a series of stored pr that check fornulls, valid codes, parent/child records, etc.
ocedures
Call Write_TXN_MASTERDIAG_Remarksupdates SUBMITED_DATA.REMARKS,
SUBMITED_DATA.TXN_MASTERDIAG_STATUS,SUBMITED_DATA.OVERALL_STATUS if error These checks are done by issuing
update statements with where clausesthat break the rules.
If 0 rows are affected, the procedurereturns a message that the check hasbeen done.
If >0 rows are affected then theprocedure returns a message that therule is not satisfied. The relevantrecords are flagged with the log id.
END TXN_MAST DIAGER
Figure A-7. Automated Data Submittal Process (continued).
A-28
For each rowflagged as bad
Inspect row
Data fixable byDBA?
Fix data
Apply ‘I’ todisposition_status field
yes
no
End for each rowflagged as bad
Data Submittal Process:Assumed steps taken by DBA
Select data from EDMS_TXN schema wheresubmittal_flag = ‘A’ or null and disposition status
<> ‘I’ and insert into EDMS_STG schema
Submittal flag = ‘A’ means onlyAdd records selected
pAll_masterprepforviews
Stored procedures
Begin Manualprocessing
End manualprocessing
Begin pAll_masterprepforviews
pAll_PrepforViewsDelInact Deletes rows wheredisposition_status=’I'
Series of stored procedures
pAll_PrepforViewsSectorUpdates sector codes withappropriate code for thetable type. Area sector codesbased on SCC
pAll_PrepforViewsDatasource Updates the datasource fieldbased on various criteria
pAll_PrepforViewsETVcalls pETV function
Updates the emission_ton_value fieldwith the results of the pETV funcion
pETV function:select conversion_factor_amt into nConvFactorfrom edms_ref.units bwhere b.meas_code = 'MASS' and b.active = 'Y' and b.unit_of_measure = p_InEmissionUnit; nETV := p_InEmission * nConvFactor/2000; return nETV
pAll_PrepforViewsETPUpdates the emission_type period fieldbased on the value of the emission_typefield
End pAll_masterprepforviews
Figure A-7. Automated Data Submittal Process (continued).A-29
Select A.O.I /Inventory /Report type
Select Reporttype
Tabular report onScreen
Retrieve Datafrom
SV_RPT_GIS1
On Screen
Choose Output
GIS/Dynamic
Send to VB moduleclsReports.cls
HTML Tablulardata reportMap Display
Select which of the12 standard
reports
Standard Reports
Call specificASP page
as per reportnumber i.e.
app_main_standard_report_SR1.asp
Select A.O.I /Inventory /Report type
Retrieve Datafrom specificsaved report
table i.e.SV_RPT_SR1
Send to VB moduleclsReports.cls
Tabular report onScreenOn Screen
Choose OutputHTML Tablular
data reportGraphical Display
Report Generation
Figure A-8. Report Generation.A-30
Select A.O.I /Inventory /
SCC/NAICS/
SIC/Pollutant
Select Reporttype
Retrieve Data fromSV_RPT_ADHOC_QUERY_
POINT
Check datavolume
Ad-Hoc
Run Queryvia
app_body_ad_hoc_query.aspand
clsAdhoc_new.cls
Small volumesubmit to
app_body_ad_hoc_reports.asp
Large VolumeSubmit to
Schedule_Adhoc_Modelling_PRD.exe
Modeling
Select A.O.I /Inventory /
Sector/Pollutant
Retrieve Data from savedreport table
SV_RPT_ADHOC_QUERY_POINT
Send to VB moduleclsModeling.cls
Choose reporttype
Retrieve Data fromSV_RPT_ADHOC_QUERY_
POINT
Large VolumeSubmit to
Schedule_Adhoc_Modelling_PRD.exe
NIF Export
Data to bedownloaded
by user
Data to bedownloaded
by user
NIFformattedData to be
downloadedby user
Large VolumeSubmit to
Schedule_Adhoc_Modelling_PRD.exe
Data to bedownloaded
by user
Ad-hoc and Modeling Reports
Figure A-8. Report GenerationA-31