Principal Site Reliability Engineer, Unix Systems

We Are

Synopsysistheleaderinengineeringsolutionsfromsilicontosystems,enablingcustomerstorapidlyinnovateAI-poweredproducts.Wedeliverindustry-leadingsilicondesign,IP,simulationandanalysissolutions,anddesignservices.WepartnercloselywithourcustomersacrossawiderangeofindustriestomaximizetheirR&Dcapabilityandproductivity,poweringinnovationtodaythatignitestheingenuityoftomorrow.

YouAre

YouhavespentyearskeepingproductionUnix/Linuxinfrastructurerunningwhenitmattersmost,andyouknowthedifferencebetweenasystemthatlookshealthyinadashboardandonethatactuallyperformsunderloadwhenthousandsofengineersaretryingtocompilecodeat9amacrossthreecontinents.Youthinkinlayers.Whenajobschedulerstartsbehavingstrangely,youdonotjustrestartit.Youtracethroughlogs,checkkernelparameters,lookatnetworksaturation,talktotheteamthatchangedtheirworkloadpatternlastweek,andfindtheactualcause.

Youarecomfortablebeingthepersonwhogetspulledintothehardestproblems,theoneswherefiveotherpeoplehavealreadylookedandwalkedawayconfused.Youaskbetterquestions.Youbuildmentalmodelsofhowdistributedsystemsactuallybehave,nothowthedocumentationsaystheyshould.YouhaveprobablyadministeredLSF,Slurm,orGridEngineinaproductionenvironmentwheredowntimemeantengineerssittingidle,andyouhavelearnedtothinkthreestepsahead.

AtSynopsys,youwillsupportinfrastructurethatdirectlyaffectshow30,000peoplebuildthechipsthatpowereverything.Thescaleisreal,theproblemsarehard,andtheteamneedssomeonewhohasalreadydonethiswork.

WhatYou'llBeDoing

• AdministerandtroubleshootlargescaleUnix/Linuxenvironmentssupportingbusinesscriticalengineeringworkloadsacrossglobaldevelopmentteams
• SupportgridandHPCinfrastructurerunningworkloadschedulerslikeIBMSpectrumLSF,Slurm,PBSPro,orGridEngineforcomputeintensiveengineeringjobs
• Diagnoseandresolvecomplexproductionissuesaffectingjobexecution,scheduling,resourceutilization,systemperformance,andinfrastructureavailability
• MaintainandimprovereliabilityofsourcecodeanddevelopmentplatformsincludingGitHub,GitLab,Perforce,andArtifactoryusedbysoftwareengineeringteamsglobally
• Buildautomation,scripts,tools,andoperationaldocumentationthatreducerepetitiveworkandimprovesystemreliabilityandscalability
• Participateinproductionsupportandoncallrotationcoveringgloballydistributedsystems,includingoccasionalevening,weekend,orearlymorningcoverage
• Conductrootcauseanalysisaftersignificantincidentsanddrivecorrectiveandpreventativeactionsthatpreventrecurrence

TheImpactYouWillHave

• KeepcriticalengineeringinfrastructureavailableandperformantforthousandsofengineersbuildingsemiconductorproductsacrosstheUS,Europe,India,andothergloballocations
• Reduceengineeringdowntimebycatchingandresolvinginfrastructureproblemsbeforetheyaffectproductivityorworkloadexecution
• ImprovethestabilityandperformanceofHPCandgridenvironmentssoengineeringteamscanruncomputeintensiveworkloadsreliablyatscale
• Makedevelopmentworkflowsfasterandmorereliablebymaintaininghighavailabilitysourcecodeandbuildinfrastructurethatengineeringteamsdependondaily
• Eliminaterecurringoperationalproblemsbybuildingsustainableautomationandprocessimprovementsratherthanrelyingonreactivefirefighting
• Accelerateincidentresolutionbyprovidingdeeptechnicalexpertiseduringcomplextroubleshootingthatspansmultipleinfrastructurecomponents
• Enablebettercapacityplanningandinfrastructuredecisionsbymonitoringsystemhealth,performancetrends,andresourceutilizationpatterns

WhatYou'llNeed

• 7+yearsofhandsonexperienceadministeringandtroubleshootingUnix/Linuxsystemsincomplexproductionenvironments,withdepthoftechnicalcapabilitybeingmoreimportantthanyearsalone
• StrongknowledgeofUnix/Linuxoperatingsystems,systemadministration,performancetroubleshooting,andproductionsupportforbusinesscriticalinfrastructure
• Experiencesupportinglargescaleinfrastructureorserverenvironmentsusedbyengineeringorsoftwaredevelopmentorganizationswherereliabilityandperformancedirectlyaffectproductivity
• Demonstratedabilitytoindependentlydiagnoseandresolvecomplexinfrastructureproblemsaffectingproductionsystemsandtechnicalusers
• Strongscriptingandautomationcapabilityusingshell,Python,Perl,orsimilarlanguagesforsystemsadministration,troubleshooting,andoperationalimprovement
• ExperiencewithHPC,gridcomputing,clustercomputing,orlargescaleengineeringcomputeenvironmentsisastrongplus
• HandsonexperiencewithIBMSpectrumLSF,PlatformLSF,Slurm,PBSPro,GridEngine,orcomparableworkloadmanagementtechnologiesishighlyvaluable

WhoYouAre

• Youcanwalkintoasituationwhereagridschedulerisbehavingunpredictably,asktherightdiagnosticquestions,tracethroughsystemlogsandjobtraces,andidentifywhethertheproblemisconfigurationdrift,akernelbug,networksaturation,oraworkloadpatternthatnobodyanticipated
• Youtakeownershipofhardproblemsanddrivethemthroughresolutionevenwhenthepathisnotobvious,pullingintherightpeopleandkeepingstakeholdersinformedwithoutneedingsomeonetomanageyourprogress
• Youwriteclearincidentsummariesandpostmortemsthathelptheteamlearnwhatactuallyhappenedandpreventthesamefailurefromhappeningagain,notjustcheckabox
• Youcanexplainacomplexinfrastructuretradeofftoasoftwareengineerintwosentenceswithoutlosingthenuance,andyouknowwhentodigdeeperversuswhentoescalate
• Youarecomfortableworkingacrosstimezoneswithgloballydistributedteams,providingclearcommunicationduringincidentsandcomplextroubleshootingactivitiesthatspanmultipleregions
• Yourecognizewhenarecurringoperationalproblemneedsasustainablesolutionratherthananothermanualworkaround,andyoufollowthroughonbuildingthatsolution

TheTeamYou'llBePartOf

Youwilljointheteamresponsibleforcriticalengineeringinfrastructureusedbysoftwareengineeringteamsglobally.Theteamsupportsinfrastructureforalargeglobalengineeringcommunity,includinggridandhighperformancecomputingenvironments,workloadschedulingplatforms,andsourcecodeanddevelopmentsystems.YouwillcollaboratewithengineeringandinfrastructureteamsacrosstheUS,Europe,India,andothergloballocations.ThisisahybridrolebasedintheBayAreawithflexibilitytoworkfromourSunnyvaleofficeandremotely.

RewardsandBenefits

Weofferacomprehensiverangeofhealth,wellness,andfinancialbenefitstocatertoyourneeds.Ourtotalrewardsincludebothmonetaryandnon-monetaryofferings.Yourrecruiterwillprovidemoredetailsaboutthesalaryrangeandbenefitsduringthehiringprocess.

#LI-Hybrid

At Synopsys, we want talented people of every background to feel valued and supported to do their best work. Synopsys considers all applicants for employment without regard to race, color, religion, national origin, gender, sexual orientation, age, military veteran status, or disability.

In addition to the base salary, this role may be eligible for an annual bonus, equity, and other discretionary bonuses. Synopsys offers comprehensive health, wellness, and financial benefits as part of a competitive total rewards package. The actual compensation offered will be based on a number of job-related factors, including location, skills, experience, and education. Your recruiter can share more specific details on the total rewards package upon request. The base salary range for this role is across the U.S.