Experienced Azure Data Engineer with a proven track record of
designing, implementing, and optimizing data solutions on the Microsoft Azure cloud platform. Proficient in developing data storage, processing, and analytics architectures to facilitate data - driven decision-making. Relevant Experience: 9 Years Total Experience: 12 Years
Work History
2022-04 - Application Developer Contact
Current IBM (Client: Heineken), Bangalore (3 months) Address • Developed and maintained CI/CD pipelines Bangalore, India 560048 using Azure DevOps to automate the Phone deployment of data engineering solutions. +91 8520866827 • Designed and implemented complex ETL E-mail processes using Azure Data Factory, sudheer.ponnana@gmail.com orchestrating data workflows across multiple sources and destinations.
• Configured Azure DevOps pipelines with
security best practices, including secret management using Azure Key Vault. Skills • Seamlessly integrated Azure Data Factory with Azure Databricks Databricks, creating end-to-end data pipelines that ensure efficient data flow and processing. Azure Synapse Analytics • Led Agile teams in developing and maintaining data engineering solutions using Azure Data Factory and Databricks, utilizing Azure Boards AWS Cloud (Lambda,EC2) for project management.
IBM (Client: Shell), Bangalore (22 months)
Python • Implemented data processing pipelines using Python and Azure services for ETL (Extract, Transform, Load) operations, data cleansing, Scala and transformation tasks. • Designed and implemented data integration MongoDB solutions using ADF, ensuring efficient extraction, transformation, and loading (ETL) processes. • Developed and maintained client-specific data Azure Storage (Gen2, ADLS, pipelines using Azure Data Factory, automating SQL) complex data movement and transformation tasks, reducing manual effort and improving project timelines. Azure Dev Ops • Integrated Git with Azure DevOps for version control, continuous integration, and continuous Agile (Scrum) deployment (CI/CD), contributing to a more efficient and automated development pipeline. • Collaborated with cross-functional teams on Git- Asp.net based repositories, ensuring a unified approach to version control and code management across Azure Data Factory, Azure Databricks, Power BI
and other data-related services.
• Served as Scrum Team member, participating in AWS sprint planning, daily stand-ups, sprint reviews, and retrospectives to ensure efficient communication and continuous improvement. Kubernetes • Utilized Azure DevOps for Scrum board management, sprint backlog tracking, and Docker release planning, ensuring transparency and real-time visibility into project progress. • Conducted regular sprint reviews with clients, gathering feedback and incorporating it into Languages subsequent sprints to enhance project English outcomes.
2020-01 - Digital Engineer Senior Consultant Hindi
2022-04 NTT DATA, Bangalore • Demonstrated expertise in working with NoSQL Telugu databases MongoDB, Cosmos DB leveraging their flexible data models and scalability features Kannada
• Led data migration projects involving the
extraction, transformation, and loading (ETL) of data between SQL and NoSQL databases, ensuring seamless transitions and minimal downtime • Configured role-based access controls (RBAC) and fine-grained permissions at the database, file, and object levels to enforce least privilege principles and mitigate insider threats. • Implemented event-driven messaging systems using technologies like Apache Kafka, RabbitMQ, or Azure Event Hubs to facilitate real- time data processing and event-driven workflows • Implemented MQTT and MiNiFi-NiFi communication protocols for efficient device- to-cloud communication in resource- constrained IoT environments. • Utilized Docker registry services (e.g., Docker Hub, Azure Container Registry) for storing and distributing Docker images across development, testing, and production environments. • Demonstrated proficiency in working with Azure cloud services, including but not limited to Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL Database, and Azure Functions. • Designed, implemented, and maintained robust backend systems for web applications using ASP.NET MVC in Visual Studio 2019 Professional. • Implemented RESTful APIs for communication between frontend and backend, ensuring efficient data transfer and adherence to industry standards. • Conducted regular code reviews, ensuring adherence to coding standards, best practices, and promoting maintainability of codebase.
2019-02 - Data Scientist
2020-01 Skoruz Technologies • Developed predictive models for demand forecasting, resulting in a 20% improvement in inventory management efficiency. • Utilized Spark SQL, DataFrame API, and RDDs for batch and streaming data processing, enabling high-performance analytics and machine learning model training. • Utilized big data storage solutions, including Hadoop Distributed File System (HDFS) and cloud-based storage (e.g., Amazon S3), for efficient and cost-effective data storage. • Implemented and optimized machine learning algorithms for classification, regression, and clustering tasks.
2015-08 - Associate Data Scientist
2019-01 Protracon technologies • Performed data analysis on large-scale datasets to uncover insights and trends, utilizing tools such as Apache Hive and Apache Pig. • Assisted in deployment and integration of machine learning models into production systems, working with senior data scientists to enhance model performance.
2012-03 - Technical Support Engineer
2014-12 Efftronics Systems Pvt. Ltd • Assisted in analysis of large datasets stored in Hadoop, gaining hands-on experience with HDFS, MapReduce, and Hadoop ecosystem tools. Created and optimized data visualizations and dashboards using tools such as Tableau, enhancing data interpretation for stakeholders.
Education
2023-2025 Master’s Degree (Bits Pilani-WILP)
2007-2011 Bachelor Degree (B.Tech – JNTU Kakinada) 2005-2007 12th Class (Board Of Intermediate-AP) 2004-2005 10 th Class (State Secondary Education - AP) Certifications