Gunjan Jain

Software Engineer

Bengaluru, Karnataka, India8 yrs 11 mos experience

AI EnabledHighly Stable

Key Highlights

Over 13 years of experience in Data Engineering.
Expert in AWS and data migration projects.
Proficient in both batch and real-time data applications.

Stackforce AI infers this person is a Data Engineering expert with strong AWS capabilities.

Contact

Skills

Core Skills

Data EngineeringAwsEaiJavaData WarehousingEtlWeb Development

Other Skills

AWS ServicesAjaxAmazon Web Services (AWS)Android App DevelopmentAthenaBizlink B2B GatewayBootstrapBusiness ObjectBusiness ObjectsCI/CDCSSData PowerData Science librariesDatapowerDocker

About

Having 13+ years of experience in developing and implementing the Data Engineering, System Design, System Integration, Analytics, batch and real-time applications using mParticle, Hadoop, Pyspark, Python(SQLAlchemy, Pydantic, FastAPI), SQL, Kafka, Iceberg, StreamSets, Snowflake, Airflow, DBT, Clickhouse, Startree/Pinot, Cube, Growthbook, DataZone, Alatian, GenAi, Vector Store, RAG, Prompt/Context Engineering, FineTuning, n8n, Vibe Coding, AWS Services like Bedrock, EMR, MSK, ECR, ECS, Code Artifact, Glue, Lambda, Open Search, Redshift, RDS Aurora Postgres and many more. Skilled in CI/CD (Jenkins with Groovy, CircleCI, Github Runners, Jfrog Artifactory), GITLAB/CVS/BitBucket, Docker, Relational/NoSql DBs, Python Data science/ML libraries, EAI (Middleware), ETL (Informatica), Reporting Tool(Preset, QuickSight, Business Objects) and various other technologies with positive attitude of exploring new arenas of work and try hands on latest technologies in free time. Languages and tools have never been a restriction for me and will never be. Always aim to add something new in my mind's database every day.

Experience

8 yrs 11 mos

Total Experience

2 yrs 2 mos

Average Tenure

Current Experience

Boston scientific

2 roles

Senior Developer

Promoted

Mar 2018 – Sep 2021 · 3 yrs 6 mos

Project Title : Data Lake Migration from Cloudera to AWS
Platform: Spark, Shell Scripting, Python, Scala, StreamSets, Kafka, Cloudera, Hadoop, AWS Services like EMR, Lambda, Glue (Crawler, ETL, Connectors), Athena, EC2, Step Function, SSM, RDS(Aurora Postgres), DMS, Dynamo DB, Kinesis (Data Stream, Firehose, Analytics), Event Bridge, Hudi (Delta Streamer/Glue Connector) , LogStash / Elastic Search with Kibana, MSK and many more.
Description : Currently actively involved in Data Lake Migration. Worked upon multiple projects to migrate tenants from on premise cloudera data lake to AWS. It includes reverse analysis of existing components in onpremise cloudera and building the alternate component on AWS. Migrated multiple tenants so far which involved hands on multiple EDH technologies and AWS services. Many more tenants to go.

SparkShell ScriptingPythonScalaStreamSetsKafka+19