Omid. S.M

Product Manager

Sydney, New South Wales, Australia17 yrs 7 mos experience

Highly Stable

Key Highlights

Expert in designing scalable data solutions.
Proficient in cloud technologies and data governance.
Strong collaboration with cross-functional teams.

Stackforce AI infers this person is a Big Data Engineer with expertise in cloud technologies and data architecture.

Contact

Skills

Core Skills

Data ArchitectureBig Data EngineeringData EngineeringCloud TechnologiesData GovernanceData WarehousingDatabase Management

Other Skills

Azure DatabricksPySparkApache KafkaApache AirflowClouderaData IngestionMetadata ManagementData Warehouse ArchitectureAzure DevOpsBMC Control-MSQLOracle DatabaseMicrosoft AzureMicrosoft SQL ServerAzure SQL

About

Microsoft/Databricks Certified Solution Designer - End to End design and implementation - Tech lead, stakeholder manager and mentor - Professional in cloud technologies: Databricks, Fabric, Azure, Synapse, AWS - IP, IC, SRB, data modeling, CRC, RFC - Hands on Advanced T-SQL, SPARK(PySpark, Scala, SQL) - ORACLE technologies (HDFS, Hive, Hadoop) - CI/CD: Jenkins, Bitbucket, Azure DevOps - Orchestration: ADF, Airflow, Control-M - DW, ETL, ELTL, Medallion Architecture - Metadata driven via Azure SQL MFA - Data Governance via unity catalogue - Legacy MS SQL Server (OLTP, DW, OLAP, SSIS) - Confluence (Wikki, Jira) - Generative AI Engineering - Test ( Unit, Regression,Integration, Sanity) proven ability to: -deliver impactful data solutions - translating business requirements into actionable insights. -Proficient in design and implement scalable/ durable pipelines - collaborating with cross-functional teams - drive data-driven decision-making - Dedicated to continuous learning and - committed to leveraging technical expertise - support dynamic and innovative environments. Please check my GitHub

Experience

17 yrs 7 mos

Total Experience

3 yrs 2 mos

Average Tenure

1 yr 7 mos

Current Experience

Optus

Big Data Enterprise Solution Designer

Oct 2024 – Present · 1 yr 7 mos · Sydney, New South Wales, Australia · On-site

Solution design and implementation
Collaboration with Strategic stakeholders
troubleshooting, brainstorming and best practices
Agile project management
End to End Design
Azure Databricks integration with other platforms
Enable enterprise-wide data connectivity and real-time processing
Big Data Engineering
Metadata Driven
Data Governance
CI/CD
Lakehouse
AWS/Azure/Databricks/Fabric/Hadoop
Medallion Architecture
Batch/Stream processing
SANDBOX/DEV/TEST/SIT/BETA/Production
Large scale BI (semantic Data Modelling/Fabric)
ESP Confluent
Salesforce Cloud development
Unified Data Platform*
(Databricks, GEN AI, ADF, ADLs gen2, Azure DevOps, confluence, Airflow, Azure SQL, SSMS, Spark SQL, PySpark, MS Fabric, Erwin, Alteryx, DBT)
AWS Integration*:
(S3, GLUE, EMR, Glue, Iceberg, Kinesis, Kafka, SageMaker, Event Bridge, Redshift, S3, Athena, Lambda, GITLAB).
Big Data Platform*
(HDFS, Cloudera, Hadoop, Spark, Teradata, Hive, Oracle, Bitbucket, Jenkins, control-M, Unix/Linux Shell, Scala, T-SQL)
VS Code, Gitbash
Confluence, Wikki, Jira

Azure DatabricksPySparkApache KafkaApache AirflowClouderaData Ingestion+11

Australian catholic university

Senior Data Engineer

Jun 2020 – Oct 2024 · 4 yrs 4 mos · North Sydney, New South Wales, Australia · On-site

Azure (ADF, Azure SQL DB, Synapse, ADLS Gen2)
AWS (Glue, RDS, Redshift, EMR, S3 bucket)
MS Fabric
Databricks (Mount storage, Unity catalog, notebooks, DLT, Work Flow, Medallion architecture)
Spark Streaming
Spark SQL
PySpark
PostgresSQL
Consulting
Best practices to read/write data
Architecting aligned with business requirements
Error handling
Test (unit, Integration, system, sanity)
Productionize metadata/codes via Azure DevOps

Azure DatabricksPySparkData IngestionData ArchitectureAccess Control ManagementAzure Storage+16

Australian museum

Snr Data Engineer

Feb 2017 – Jun 2020 · 3 yrs 4 mos · Sydney, New South Wales, Australia · On-site

Playing a key role in technical operations, optimisation and development
Implementing proactive fault detection and debug code techniques
Collaborating with the team to ensure efficient handling of access control systems, emphasizing Integriti platform expertise.
Utilizing Power BI for data-driven incident reporting and decision-making.
Managing daily technical operations, emphasizing seamless database-backed functions.
Translate data requirements to technical solutions
Perform advance and SQL queries scalable SP (stored procedures).
Respond to requests from business / stakeholders through Service Now and find Resolution of assigned task
. Data warehousing, ETL Development, Azure data factory, SSAS Processing
Employing Service Now for task assignment and troubleshooting.

Transact-SQL (T-SQL)PySparkAccess ControlCommunicationSQL database designOracle Database+13

Bluevision

Data Engineer

Mar 2015 – Feb 2017 · 1 yr 11 mos · Sydney, New South Wales, Australia · On-site

Leveraging expertise in SQL Server optimisation and performance tuning to ensure the efficient and effective delivery of data to support business decision-making.
Communicated effectively with both technical and non-technical teams
Participated in troubleshooting database-related issues and collaborated with teams for resolution.
Developing and maintaining ETL processes using SSIS, Visual Studio, Azure Data Factory.
Design and Implement SSAS Multidimensional and Tabular models
Utilising strong T-SQL and scalable stored procedure (SP) development skills to create scalable and optimised queries and processes.
Monitoring routine packages for ETL, OLAP Processing Data, database backup and recovery processes to ensure data integrity.

Extract, Transform, Load (ETL)Data CleaningDashboardTeamworkConsultingMirro+7

Fitohitech

ETL/SQL Developer

Jul 2011 – Feb 2015 · 3 yrs 7 mos · On-site

Administered and maintained SQL Server databases, ensuring high availability and performance.
Implemented security measures to protect data integrity and prevent unauthorized access.
Designed, implemented, and managed OLTP (Online Transaction Processing) architecture.
Defined checks, triggers, and XML email notifications to ensure data integrity and timely alerts.
Monitored and optimized database performance through indexing, query optimization, and resource management.
Troubleshot and resolved database issues, minimizing downtime and ensuring smooth operations.
Managed data integration processes, ensuring seamless data flow between systems.
Developed and maintained applications using C# and Visual Studio.
Supported software developers by providing technical guidance and troubleshooting assistance.
Implemented error handling and debugging procedures to ensure robust application performance.
Worked with development teams to support database-related needs and provide technical guidance.
Supported BI developers by activating services such as jobs, access controls, and Change Data Capture (CDC).
Managed maintenance jobs for maintenance tasks, including backups, indexing, and performance tuning.

SQLDatabase AdministrationStar SchemaSQL DBAMicrosoft SQL ServerSQL Server Integration Services (SSIS)+5

Telcoir

Software Engineer

Sep 2008 – Jul 2011 · 2 yrs 10 mos · On-site

Designed, developed, and maintained core telecom software applications using C/C++, and
SQL for backend systems, ensuring scalability and performance in high-traffic environments.
Collaborated on integrating various internal and external telecom systems, improving
communication between different data sources and user-facing services.
Participated in the early stages of build automation using tools like Ant, Maven, and Jenkins
to streamline software deployment and improve the consistency of builds across different
environments.
Used Subversion (SVN) and CVS to manage source code and coordinate with development
teams on version control, ensuring smooth integration of code across multiple systems.
Developed unit tests and worked closely with QA teams to identify and resolve bugs early in
the development cycle.
Worked closely with cross-functional teams including product managers, system architects,
and QA engineers to ensure software delivered met business needs. Also documented the
software architecture and code for future reference.