ࡱ> BxV  !"#$%&'()*+,-./0123456789:;<=>?@AWUEFGHIJKLMNOPQRSTXYZ[\]^_`abcdefghijklmnopqrstuvwyz{|}~RdO)锿CPowerPoint Document(SummaryInformation(D DocumentSummaryInformation8"( b/ 0DTimesY$P"/P"/P@ I@n@NDArialY$P"/P"/P@ I@n@N ` .  @n?" dd@  @@`` 8&M +T 2 c $@Auʚ;2Nʚ;g4jdjdn`pppp@ <4!d!dgʚ;<4ddddgʚ; <4BdBdʚ;.8___PPT10    ___PPT9@@@@0h___PPT2001D<4X ___PPTMac11z @f   hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography  ,namd$ Times Roman  ,namd$ Times Roman  ,namd$ Times Roman  ,namd$ Times Roman  ,namd$ Times Roman  ? % 2Batch Queue Based Scheduler for DAGs with MPI jobs Presenter: Ryan Zhang  Overview )Overall approachSchedule based on clusters(batch queue) The resource pool consists of clusters instead of individual computing node Each cluster is a homogenous resources pool and contains one or more periods of available time(slot) Dispatch each task in the DAG to one of the slots. By carefully record the current available time of each slot, one can find the slot results in the earliest finish time for each task.:)j) '*>2,/I!Slot Start Time    ChallengesCreate the initial query based on the DAG and the performance data. Current approach: query for the DAG s width number of the fastest processor type and only one slot cover all the execution time In the future: express equivalence between processors and have finer grained slots(ask for one slot for one level or several level combined):D D UY:( ChallengesDetermine the number of nodes one MPI job need. Current approach: always use the optimal number of nodes that the performance model provide In the future: explore more options on the trade off between the speed up and the delay to get the resources.:00\m PAAH* ChallengesDetermine the number of slots to ask for multiple independent MPI jobs. Current approach: always ask for one slot. In the future: explore the effect of asking for more slots to decrease the wait time.:HH+U Y    Future WorkThe current LEAD DAG has only one MPI task that runs more than an hour In the future, it will be more interesting to try to schedule DAGs with multiple MPI jobs and conditional execution. Ask for different slots on different resources&Gu/b'7F  `` 33` Sf3f` 33g` f` www3PP` ZXdbmo` \ғq>9y`Ӣ` 3f3ff` 3f3FKf` hk]wwwfܹ` ff>>\`Y{ff` R>&- {p_/̴>?" dd@,|?" dd@   " @ ` n?" dd@   @@``PR    @ ` ` p>>  (    6D#/ P l T Click to edit Master title style! !  0 H#/  l RClick to edit Master text styles Second level Third level Fourth level Fifth level!     S  0N#/ `` l P*   0 T#/ `  l R*   0Y#/ `  l R* H  0޽h ? 33 $Blank Presentation 0(  l  C 5;$ l l  C "/ `   l H  0޽h ? 33<  R<J<@)* ;(   l  C +/   l   B@~"` 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  G Resources" 0  #  <@E-/"` 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  I G L O B U S" 0  #  <*/"`` 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  H"0 #   <`*/"`8 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  a#LEAD App Manager ------- Translator"$0 $#f  0"`P@ 0   < */"` 00___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  VMapper"0 #   <@*/"` 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  pvgDL Resource Negotiator"0 #  <@*/"`` p 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  OPerformance Model"0 # RB  s *DP  <I-/# 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  MDAG + Constraints 0 # RB  @ s *DPRB  s *D@RB  s *D`@`  < -/"``0@ 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  ]vgES "0 #RB  s *DP `PRB  s *D `r2  <ZG:6I"` X  <@-/ ,}0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  JIterative Find 0 # RB  s *D `  <@-/ n B 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  I Find and Bind 0 # RB  s *D    <-/ p= 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  DRun Task 0  #   <-/ P 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  ^vgLaunch 0  # RB  s *DP `P RB  @ s *D `   <-/  0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  lProbe vgStatus 0 # RB  @ s *D    <P-/ r 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  KLEAD Job Status 0 # RB  s *D`0`RB ! s *DP 0P { " 0./#>`0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  K Slot Allocate"0 2#  # <./ V 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  KReal Job submit 0 #  $ <P ./"`  0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  ANWS"0 #~2 % HxG:6IHIf"``P & <./"` P0 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  AMDS"0 # ' <./"` p 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  PBatch Q Prediction"0 # RB ( s *D@  RB ) s *D@ P RB * s *D@  H  0޽h ? 33  P$( kU(U( r  S /   l r  S 0/ l H  0޽h ? 33     ` xE ( 4 xr x S H/`0  l  x 0L/`  fCluster A 10 Itanium  x 0Q/pp0@___PPT10 V___PPT980___PPTMac11 ,namd$ Times Roman  rCluster B 15 Opteron(   x 6pX/Xp` 8Slot A_1   x 0`/0  ` ZSlot A_2    x 0e/p0 ` 9 Slot A_3     x 0i/0@` 8Slot B_1    x 0Pn/ p  8Job2_2~5   x 0r/ P ` 8Job3_0~2   x 0pw/  6Job2_1 x 0{/` 8Job1_0~7  H x 0޽h ? 33  p$(  $l $ C  /P  l l $ C @/  l H $ 0޽h ? 33  $(    r  S `)/P  l r  S */  l H  0޽h ? 33  $(  r  S P/P  l r  S /  l H  0޽h ? 33   ( `T l  C $/P  l l  C  $/ l H  0޽h ? 33cxp^RЀ3ÿ lHbP  @AL G@;b `B&V2,/I!Slot Start Time    ChallengesCreate the initial query based on the DAG and the performance data. Current approach: query for the DAG s width number of the fastest processor type and only one slot cover all the execution time In the future: express equivalence between processors and have finer grained slots(ask for one slot for one level or several level combined):D D UY:( ChallengesDetermine the number of nodes one MPI job need. Current approach: always use the optimal number of nodes that the performance model provide In the future: explore more options on the trade off between the speed up and the delay to get the resources.:00\m PAAH* ChallengesDetermine the number of slots to ask for multiple independent MPI jobs. Current approach: always ask for one slot. In the future: explore the effect of asking for more slots to decrease the wait time.:HH+U Y    Future WorkThe current LEAD DAG has only one MPI task that runs more than an hour In the future, it will be more interesting to try to schedule DAGs with multiple MPI jobs and conditional execution. Ask for different slots on different resources&Gu/b'7F <  ;;@(* M;(   l  C +/   l   B@~"` 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  G Resources" 0  #  <@E-/"` 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  I G L O B U S" 0  #  <*/"`` 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  H"0 #   <`*/"`8 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  a#LEAD App Manager ------- Translator"$0 $#f  0"`P@ 0   < */"` 00___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  VMapper"0 #   <@*/"` 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  pvgDL Resource Negotiator"0 #  <@*/"`` p 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  OPerformance Model"0 # RB  s *DP  <I-/# 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  MDAG + Constraints 0 # RB  @ s *DPRB  s *D@RB  s *D`@`  < -/"``0@ 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  ]vgES "0 #RB  s *DP `PRB  s *D `|  <@-/P T0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  @Find 0 # RB  s *D `|  <@-/ \0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  @Bind 0 # RB  s *D    <-/ p= 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  DRun Task 0  #   <-/ P 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  VvgLaunch 0  #  RB  s *DP `P RB  @ s *D `   <-/  0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  lProbe vgStatus 0 # RB  @ s *D    <P-/ r 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  KLEAD Job Status 0 # RB  s *D`0`RB ! s *DP 0P { " 0./#>`0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  K Slot Allocate"0 2#  # <./ V 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  KReal Job submit 0 #  $ <P ./"`  0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  ANWS"0 #~2 % HxG:6IHIf"``P & <./"` P0 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  AMDS"0 # ' <./"` p 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  PBatch Q Prediction"0 # RB ( s *D@  RB ) s *D@ P RB * s *D@  H  0޽h ? 33r~ʠ~+@