article

Free access

EXPRESS: a data EXtraction, Processing, and Restructuring System

Editor: David K. Hsiao Authors:

V. Y. LumAuthors Info & Claims

ACM Transactions on Database Systems (TODS), Volume 2, Issue 2

Pages 134 - 174

https://doi.org/10.1145/320544.320549

Published: 01 June 1977 Publication History

Abstract

EXPRESS is an experimental prototype data translation system which can access a wide variety of data and restructure it for new uses. The system is driven by two very high level nonprocedural languages: DEFINE for data description and CONVERT for data restructuring. Program generation and cooperating process techniques are used to achieve efficient operation.

This paper describes the design and implementation of EXPRESS. DEFINE and CONVERT are summarized and the implementation architecture presented.

The DEFINE description is compiled into a customized PL/1 program for accessing source data. The restructuring specified in CONVERT is compiled into a set of customized PL/1 procedures to derive multiple target files from multiple input files. Job steps and job control statements are generated automatically. During execution, the generated procedures run under control of a process supervisor, which coordinates buffer management and handles file allocation, deallocation, and all input/output requests.

The architecture of EXPRESS allows efficiency in execution by avoiding unnecessary secondary storage references while at the same time allowing the individual procedures to be independent of each other. Its modular structure permits the system to be extended or transferred to another environment easily.

References

[1]

BAKKOM, D.E., ANI) BEHYMER, J.A. Implementation of a prototype generalized file translator. Proc. 1975 ACM SIGMOD Int. Conf. on Management of Data, San Jose, Calif., 1975, pp. 99-110.

Digital Library

[2]

BIRSS, E.W., AND Far, J.P. Generalized software for translating data. Proc. AFIPS 1976 NCC, AFIPS Press, Montvale, N.J., pp. 889-899.

[3]

DEPPE, M., LEWIS, K., AND SWARTWOUT, D. Operational software for restructuring network data bases. Working Paper DT 3.2, Data Translation Proj., U. of Michigan, Ann Arbor, Mich., 1976.

[4]

FRy, J.P., FRANK, R.L., AND HERSHEY, E.S. III. A developmental model for data translation. Proc. 1972 SIGFIDET Workshop on Data Description, Access and Control, Denver, Colo., pp. 77-105.

Digital Library

[5]

FRY, J.P., S~ITH, D.P., AND TAYLOR, R.W. An approach to stored data definition and translation. ACM 1972 SIGFIDET Workshop on Data Description, Accesz and Control, Denver, Colo., pp. 13-55.

Digital Library

[6]

FRY, J.P., SMITH, D.C.P., TAYLOR, R.W., FRANK, R.L., LUM, V.Y., BEHYMER, J.A., AND SHNEID~.R~AN, B. Stored-data description and data translation: A model and language. Inform. Syst. 2, 3 (1977), 95-160.

[7]

HousEL, B.C., LuM, V.Y., AND SHY, N.C. Architecture to An Interactive Migration System (AIMS). Proc. ACM SIGMOD Workshop on Data Description, Access and Control, Ann Arbor, Mich., May 1974, pp. 157-169.

Digital Library

[8]

HOUSEL, B.C., AND SHy, N.C. A high-level data manipulation language for hierarchical data structures. Proc. Conf. on Data Abstraction, Definition and Structure, Salt Lake City, Utah, March 1976, pp. 155-168.

Digital Library

[9]

HOUSEL, B.C., SMITH, D.P., SHU, N.C., AND LuM, V.Y. DEFINE--A nonprocedural data description language for de/ining information easily. Proc. ACM Pacific 75, San Francisco, Calif., April 1975, pp. 62-70.

[10]

IBM CORP. Information Management System, General Information Manual. IBM: Pub. No. GH20-1260, IBM Corp., White Plains, N.Y., 1975.

[11]

LooMIs, M.E. Resource-constrained scheduling of tasks with precedence relationships. Res. Rep. No. RJ 1746, IBM Res. Lab., San Jose, Calif., 1976.

[12]

Lug, V.Y., SHU, N.C., AND HOVSEL, B.C. A general methodology for data conversion and restructuring. IBM J. Res. and Develop. 20, 5 (1976), 483--497.

[13]

MEaTEN, A.G., AND FRY, J.P. A data description language approach to file translation. Proc. ACM SIGMOD Workshop on Data Description, Access and Control, Ann Arbor, Mich., May 1974, pp. 191-205.

Digital Library

[14]

NAVATHS, S.B., AND FRY, j.P. Restructuring for large databases: Three levels of abstraction. ACM Trans. Database Syst. 1, 2 (June 1976), 138-158.

Digital Library

[15]

RAMIR~.Z, J.A. Automalic Generation of Data Conversion Programs Using a Dala Description Language (DDL), Vols. 1, H. U. of Pennsylvania, Philadelphia, Pa., May 1973.

[16]

RA~IREZ, J.A., RIN, N.A., AND PRAWES, N.S. Automatic generation of data conversion programs using a data description language. Proc. ACM SIGMOD Workshop on Data Description, Access and Control, Ann Arbor, Mich., May 1974, pp. 207-225.

Digital Library

[17]

SCHNEIDER, G.M., AND DESAUTELS, E.J. Design of a file translation language for networks. Inform. Syst. 1, 1 (Jan. 1975), 23-31.

[18]

SI~S~.ID~RMAN, B., XND SHAPIRO, S.C. Towards a theory of encoded data structures and data translation. Int. J. Comptr. Inform. Sci. 5, 1 (1976), 33-43.

[19]

SHOSHANI, A. A logical-level approach to database conversion. Proc. 1975 ACM SIGMOD Conf. Management of Data, San Jose, Calif., pp. 112-122.

Digital Library

[20]

SHOSHANI, A., AND BRANDON, K. On the implementation of a logical data base converter. Proc. Int. Conf. on Very Large Data Bases, Framingham, Mass., Sept. 1975, pp. 529-531.

Digital Library

[21]

SHU, N.C., ttOUSEL, B.C., AND LUM, V.Y. CONVERT: A high level translation definition language for data conversion. Comm. ACM 18, 10 (Oct. 1975), 557-567.

Digital Library

[22]

SIBLEY, E.H., AND TAYLOB, R.W. A data definition and mapping language. Comm. ACM 16, 12 (Dec. 1973), 750-759,

Digital Library

[23]

SmTn, D.P. An approach to data description and conversion. Ph.D. Diss., U. of Pennsylvania, Philadelphia, Pa., 1971.

[24]

SMITH, D.P. A method for data translation using the stored data definition and translation task group languages. ACM 1972 SIGFIDET Workshop on Data Description, Access and Control, Denver, Colo., pp. 107-124.

Digital Library

[25]

TAYLOR, R.W. Generalized data base management system data structures and their mapping to physical storages. Ph.D. Diss., U. of Michigan, Ann Arbor, Mich., 1971.

Digital Library

[26]

WINTERS, E.W., AND DICKEY, A.F. A business application of data translation. Proc. 1976 ACM SIGMOD Conf., Washington, D.C., June 1976, pp. 189-196.

Cited By

Gleim LPennekamp JLiebenberg MBuchsbaum MNiemietz PKnape SEpple AStorms STrauth DBergs TBrecher CDecker SLakemeyer GWehrle K(2020)FactDAG: Formalizing Data Interoperability in an Internet of ProductionIEEE Internet of Things Journal10.1109/JIOT.2020.29664027:4(3243-3253)Online publication date: Apr-2020
https://doi.org/10.1109/JIOT.2020.2966402
Katz SBarnas KDiaz MHampton S(2019)Data system design alters meaning in ecological data: salmon habitat restoration across the U.S. Pacific NorthwestEcosphere10.1002/ecs2.292010:11Online publication date: Nov-2019
https://doi.org/10.1002/ecs2.2920
Vlachou CPefkianakis IKim K(2018)LTERadarProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/32244282:2(1-31)Online publication date: 13-Jun-2018
https://dl.acm.org/doi/10.1145/3224428
Show More Cited By

Index Terms

EXPRESS: a data EXtraction, Processing, and Restructuring System

Recommendations

CONVERT: a high level translation definition language for data conversion

This paper describes a high level and nonprocedural translation definition language, CONVERT, which provides very powerful and highly flexible data restructuring capabilities. Its design is based on the simple underlying concept of a form which enables ...
Compilation of Nonprocedural Specifications into Computer Programs

The paper describes the compilation of a program specification, written in the very high level nonprocedural MODEL language, into an object, PL/1 or Cobol, procedural language program. Nonprocedural programming languages are descriptive and devoid of ...
Architecture to an interactive migration system (AIMS)
SIGFIDET '74: Proceedings of the 1974 ACM SIGFIDET (now SIGMOD) workshop on Data description, access and control

Growth in the computer industry produces a need to convert data and/or programs from one system to another from time to time. While this process has been going on for years, the techniques used to execute this task have been ad hoc and expensive. Very ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Database Systems

ACM Transactions on Database Systems Volume 2, Issue 2

June 1977

103 pages

ISSN:0362-5915

EISSN:1557-4644

DOI:10.1145/320544

Editor:
David K. Hsiao
Ohio State Univ., Columbus

Issue’s Table of Contents

Copyright © 1977 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 1977

Published in TODS Volume 2, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

147
Total Citations
View Citations
950
Total Downloads

Downloads (Last 12 months)227
Downloads (Last 6 weeks)44

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gleim LPennekamp JLiebenberg MBuchsbaum MNiemietz PKnape SEpple AStorms STrauth DBergs TBrecher CDecker SLakemeyer GWehrle K(2020)FactDAG: Formalizing Data Interoperability in an Internet of ProductionIEEE Internet of Things Journal10.1109/JIOT.2020.29664027:4(3243-3253)Online publication date: Apr-2020
https://doi.org/10.1109/JIOT.2020.2966402
Katz SBarnas KDiaz MHampton S(2019)Data system design alters meaning in ecological data: salmon habitat restoration across the U.S. Pacific NorthwestEcosphere10.1002/ecs2.292010:11Online publication date: Nov-2019
https://doi.org/10.1002/ecs2.2920
Vlachou CPefkianakis IKim K(2018)LTERadarProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/32244282:2(1-31)Online publication date: 13-Jun-2018
https://dl.acm.org/doi/10.1145/3224428
Berger DBeckmann NHarchol-Balter M(2018)Practical Bounds on Optimal Caching with Variable Object SizesProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/32244272:2(1-38)Online publication date: 13-Jun-2018
https://dl.acm.org/doi/10.1145/3224427
Fuxman AMiller R(2018)Schema MappingEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_964(3289-3297)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_964
Popa L(2018)Data ExchangeEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_960(755-762)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_960
Simitsis AVassiliadis P(2018)Extraction, Transformation, and LoadingEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_158(1432-1440)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_158
Zhu WGuo ZCheng YSheth ANgonga AWang yChang EŚlęzak DFranczyk BAlt RTao X(2017)Research on design and implementation of data exchange systemProceedings of the International Conference on Web Intelligence10.1145/3106426.3109048(1166-1170)Online publication date: 23-Aug-2017
https://dl.acm.org/doi/10.1145/3106426.3109048
Ravitz JStephenson CParker KBlazevski J(2017)Early Lessons from Evaluation of Computer Science Teacher Professional Development in Google’s CS4HS ProgramACM Transactions on Computing Education10.1145/307761717:4(1-16)Online publication date: 26-Aug-2017
https://dl.acm.org/doi/10.1145/3077617
Outlay CPlatt AConroy K(2017)Getting IT TogetherACM Transactions on Computing Education10.1145/306883817:4(1-17)Online publication date: 24-Aug-2017
https://dl.acm.org/doi/10.1145/3068838
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents