MyPage is a personalized page based on your interests.The page is customized to help you to find content that matters you the most.

I'm not curious

Senior Hadoop Developer

Location Charlotte, United States
Posted 29-September-2021

Senior Hadoop Developer

12 Month Contract (Possible Contract-to-Hire)

Charlotte, NC (Remote to start, onsite in January)


Bachelors Degree in Engineering /Computer Science, CIS, or related field (or equivalent work experience in a related field)3+ years experience with Hadoop ecosystems (Hadoop, hive, sqoop, oozie)Python (highly preferred.) Java, Scala experienceShell scriptingPySpark/spark experienceExperience pulling data from KafkaCloud experience (Preferably GCP)Machine Learning preferredAgile experience

Job Description

Data Engineer with Airflow and MLOps experience IN GCP for Enterprise PersonalizationWill be collaborating with Data Scientist, Software Engineer, Project Managers to deliver mostly data pipeline to support customizationsNeed to optimize work processesMentor Jr DevelopersON Prem and Cloud migrationsMostly a development experience (very little analysis)


Responsible for the development, maintenance, and enhancements of BI solutions of varying complexity levels across different data sources like DBMS, File systems (structured and unstructured) on-prem and cloud infrastructure; creates level metrics and other complex metrics; use custom groups, consolidations, drilling, and complex filtersDemonstrates database skill (Teradata/Oracle/Db2/Hadoop) by writing views for business requirements; uses freeform SQLs and pass-through functions; analyzes and finds errors from SQL generation; creates RSD and dashboardResponsible for building, testing and enhancement of BI solutions from a wide variety of sources like Teradata, Hive, Hbase, Google Big Query and File systems; develops solutions with optimized data performance and data securityWorks with business analysts to understand requirements and create dashboard/dossiers wireframes; makes use of widgets and Vitara charts to make the dashboard/dossiers visually appealingCoordinates and takes necessary actions from DART side for application upgrades (e.g., Teradata, Workday), storage migration, and user management automation; supports such things as Cluster Management and Project Configuration settings

Awards & Accolades for MyTechLogy
Winner of
Top 100 Asia
Finalist at SiTF Awards 2014 under the category Best Social & Community Product
Finalist at HR Vendor of the Year 2015 Awards under the category Best Learning Management System
Finalist at HR Vendor of the Year 2015 Awards under the category Best Talent Management Software
Hidden Image Url