SEMINARS AND WORKSHOPS

Big Data Architecture and ETL Pipelines

   The Department of Computer Science and Engineering (Data Science) hosted an expert talk on Big Data Architecture and ETL Pipelines on April 24th, 2025. Dr. Mounica, an experienced Technology Consultant at Wells Fargo, led the session. She introduced Big Data, its significance, and the challenges of handling massive datasets.
The talk covered big data system architecture, including data ingestion, storage, processing, and visualization. Dr. Mounica highlighted the role of Python and its libraries in big data environments. A key focus was PySpark, its role in distributed data processing, and its functionalities like RDDs and DataFrames. She demonstrated Power BI for data visualization, showing its importance in business analytics. The session bridged theoretical concepts with real-world applications for students, and they actively participated in a Q&A segment, gaining industry insights.