Nothing Special   »   [go: up one dir, main page]

skip to main content
department
Open access

Prediction-Serving Systems: What happens when we wish to actually deploy a machine learning model to production?

Published: 01 February 2018 Publication History

Abstract

This installment of Research for Practice features a curated selection from Dan Crankshaw and Joey Gonzalez, who provide an overview of machine learning serving systems. What happens when we wish to actually deploy a machine learning model to production, and how do we serve predictions with high accuracy and high computational efficiency? Dan and Joey’s selection provides a thoughtful selection of cutting-edge techniques spanning database-level integration, video processing, and prediction middleware. Given the explosion of interest in machine learning and its increasing impact on seemingly every application vertical, it’s possible that systems such as these will become as commonplace as relational databases are today

Cited By

View all
  • (2024)Capability Indices for Digitized Industries: A Review and Outlook of Machine Learning Applications for Predictive Process ControlProcesses10.3390/pr1208173012:8(1730)Online publication date: 16-Aug-2024
  • (2023)TBDB: Token Bucket-Based Dynamic Batching for Resource Scheduling Supporting Neural Network Inference in Intelligent Consumer ElectronicsIEEE Transactions on Consumer Electronics10.1109/TCE.2023.333963370:1(1134-1144)Online publication date: 5-Dec-2023
  • (2022)SOL: safe on-node learning in cloud platformsProceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3503222.3507704(622-634)Online publication date: 28-Feb-2022
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Queue
Queue  Volume 16, Issue 1
Web Services
January-February 2018
115 pages
ISSN:1542-7730
EISSN:1542-7749
DOI:10.1145/3194653
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 February 2018
Published in QUEUE Volume 16, Issue 1

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Department
  • Research
  • Editor picked

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)923
  • Downloads (Last 6 weeks)48
Reflects downloads up to 22 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Capability Indices for Digitized Industries: A Review and Outlook of Machine Learning Applications for Predictive Process ControlProcesses10.3390/pr1208173012:8(1730)Online publication date: 16-Aug-2024
  • (2023)TBDB: Token Bucket-Based Dynamic Batching for Resource Scheduling Supporting Neural Network Inference in Intelligent Consumer ElectronicsIEEE Transactions on Consumer Electronics10.1109/TCE.2023.333963370:1(1134-1144)Online publication date: 5-Dec-2023
  • (2022)SOL: safe on-node learning in cloud platformsProceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3503222.3507704(622-634)Online publication date: 28-Feb-2022
  • (2021)A Service Management Method for Distributed Deep Learning2021 International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC52510.2021.9621013(958-960)Online publication date: 20-Oct-2021
  • (2019)ML4IoT: A Framework to Orchestrate Machine Learning Workflows on Internet of Things DataIEEE Access10.1109/ACCESS.2019.29481607(152953-152967)Online publication date: 2019
  • (2018)PretzelProceedings of the 13th USENIX conference on Operating Systems Design and Implementation10.5555/3291168.3291213(611-626)Online publication date: 8-Oct-2018

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media