Data Engineer Intern

Duration: 2 - 4 Months Internship Type: Undergraduate; Pre-University   Raw data flows at high speed and high volume across enterprise systems. The multiplicity of file format and erroneous file content often make integration and maintenance of systems a challenging task. Data Engineers need to find trends in this complex environment and develop algorithms to make raw streaming data useful to the organisation.  As a Data Engineer intern, you will: • Gain valuable experience in big data manipulation and acquire deep knowledge in database design and programming. • Learn to manage, analyse and extract database-centric distinctive information and enrich them in real time to provide value to the end user. • Be able to hone your technical skills using multiple programming languages and scripting tools. Broad Deliverables • Conduct technology scan and proof-of-concept. • Data acquisition, query and manipulation to address business issues. • Design, develop, test and deliver the system. • Present the system to management and users. Possible Projects* • DPI accelerator (using Snort/Regex) • Pcap search engine • KSQL real-time stream processing Prerequisites/Skills Required • Prior knowledge in programming