AN EXPERIMENTAL STUDY AND O P T I t l I Z A T I O N OF OPERATING SYSTEMS
0. I. Aven, N.:i.Gurin,
Ya.n.
;.O~LLT
ad !i.B.
Lei~~an
I r ~ s t i t u t eof 2oncroi Ccierlces Eoscovl, USSR
ABSTRACT This paper i s devoted t o experimental study of o p e r a t i n g systems through sof Ware measurements. The b a s i c s t a g e s of experimental s t u d i e s a r e considered. Software monitor ATOM which i s f l e x i b l e measurement t o o l t o o b t a i n d e t a i l e d d a t a on the a c t u a l computer system performance i s described. The ATOM i s used t o study en ICL Srstem 4-70 J - l e v e l d i s k o p e r a t i n g system with t h e use of programs a c t i v i t y t r a c e and input/output t r a c e . The b o t t l e n e c k s of t h e system and v a r i o u s w a y s of t u n i n g and optimization a r e studied.
t i n g system " under normal load. A special software monitor ATOM was developed t o c a r r y o u t t h e measurements. The main r e s u l t s include : (1) Supervisor a c t i v i t y a n a l y s i s , ( 2 ) system programs act;ivity a n a l y s i s ,
(3) system f i l e s a l l o c a t i o n problem and (4) improvement of system f i l e a c c e s s
EXPXRIMEXTTALENVIXC~NIVZENT
The configuration of the ICL Eystorn 4-70 includes : a c e n t r a l processor, 3b4K bytes of main memory, 4 x 7.25 M b y t e s r e INTRODUCTION placeable a i s k d r i v e s ( s i m i l a r t o In..: 2 3 1 1 ) The e f f i c i e n c y of complex computer sy.>tems on one channel, 5 x 29.2 K b y t e s re?lazeable d i s k d r i v e s ( s i m i l a r t o IBM 2314) on depends on an enormous n w b e r of v a r i a b l e s r a n ~ i n gfrom hardware p o t e n t i a l to software the o t h e r channel, 6 tape d r i v e s , t e r z i n a l s ( t e l e p r i n t e r s and d i s p l a y s ) and v a r i o u s 1 / 0 a l d o r i t h n s to l a b o r p r o d u c t i v i t y . The opera t i o n of co iputers can be analyzed in a num- devices. The r e s o l u t i o n of t h e system timer i s in microsecond range. b e r of ways including a n a l y t i c a l models,
:
This paper r e p o r t s on an experimental study of t h e ICL :;ysc;em 4-70 J-level d i s k opera-
Measurement-based experimental study o f ceaputer 2ysterps deals with the cathering
,
p m m n t a t i o n md i n t e r p r e t a t i o n of d a t a on actual computer sjstem performance.
-
Data GatherThere severalkinds Of measurement f o r d a t a gathering: hardware monitors, -sampling type software monitors, t r a c i n g type sof Ware monitors (of en r e f e r r e d t o as event-recording monitors).
-
tracing
tme
softwaFa
des-
in this is a measurement t o o l and does n o t r e q u i r e modificOperating 'rstem* To reduce ation Of t h e overheads the t r a c e s of only most imp o r t a n t processes a r e recorded.
AH AUTONOMOUS TRACELORIENTED MONITOR
In Autonomous Trace-Oriented Monitor ,ATOM, i s a powerful and f l e x i b l e t o o l of software measurements. It does n o t r e q u i r e modi f i c a t i o n of the operating system; the mani t o r i s l i n k e d t o t h e o e r a t i n g system by the binding technique < 3]P. ATOM
.pig.,
of a measuring
aria
control s e c t i o n s . The former includes measwing procedures collect the desired data. The c o n t r o i s e c t i o n i s comprized of routines to bind aria to unbind the meas=ing procedures and the operating system, t o perform data bcrffering and input,output operations, t o communicate with o p e r a t o r , etc.
Data Repre s e n t a t i o n S t a t i s t i c a l processing of l a r g e a ~ ~ ~ofn t The s monitor is entered into the system as a d a t a i s a p r e r e q u i s i t e of e f f e c t i v e U r s - usual job. During the time is. The d a t a may be represented as : it o b t a i n s the supervisory s t a t u s and binds formatted l i ~ t k of o buurce a a t a , t r a c e u , the measuring and the operating e t c . over c e r t a i n p e r i o d s , system i n s p e c i f i e d measuring points. Meassimple s t a t i s t i c a l r e p r e s e n t a t i o n s such uring procedures gather the needed infomaa s means, variances and hystograms, t i o n u n t i l reaching a s p e c i f i e d amount of time-oriented displays. information o r u n t i l an o p e r a t o r ' s intervention. Then the monitor unbinds the measurMore methods are needed, however, ingprocedures and the operating system and f o r a n a l y s i s of i n t e r r e l a t i o n s between corn- terminates the p u t e r system elements. In t h i s paper cer-
-
-
-
tdn such a s "state-to-state s t a t e s ' ' and others.
be used
t r a n s i t i o n s " ,Itmean
ATOM's specific features and advantages a r e : system need not be modified, - the - the monitor i s bound t o the operating syst e n during the system's operation, - f l e x i b i l i t y i n s e l e c t i o n of measuring
Data Analysis and InterSimple techniques such a s "looking on the points, data" a r e u s e f u l f o r preliminary estimation ease of deletion, addition and altering and f o r n u l a t i o n of hypotheses. Common s t a t - the procedures, i s t i c a l nethods such a s r e g r e s s i o n ana corease of implementation and r e l a t i o n a n a l y s i s c m be employea t o unrave l the r e l z t i o n s between c e r t a i n parameters pROGHMdS ACTIVITY AfiAiYSIS anc f o r f o r e c a s t i n g the e f f e c t of changing one of them on the o t h e r s . The d a t a collec- hograms activity permits:determte6 can be used to the 'jstem Or i n a t i o n of F r o g r m a * needs i n s y s t e a resouri t s versions. ces; identification o f she most loaded re,-
-
-
.
o u r c e s and :nail1 consumers of t h e r e s o u r c e , ; i d e n t i f i c a t i o n 9f t h e r e a s o n s f o r i n e f f e c t i v e use o f t h e r e a c ~ u - c e s ; s e l e c t i o nof n o a t s u i t a b l e a l s o r i t h m s f o r p r o g r a x :;cIied-ding and e f f e c t i v e l e v e l of l n u l t i r r ~grazuning. I n our case the a n d y s i , leliec: cn progran a c t i v i t y t r a c e which z c n t s i n s the d a t a nece s s a y t o answer the questions posed.
program car, oe i n t h e f o ~ l o w i n g, t s t e s : E x e c u t i o n , Beaay, d a i t a,;a I n a c t i v e . The f i r s t t h r e e s t a t e s a e r;nonn a d a c c i v e . Reaay i, a a s o c i a t e u w i t h t h e lpr , c e s s o r 8s w a i Ling a!?(:h 3 i t ili31lo i t a t a e s e t of w a i t c o n L L L ~ o n , sucr. :s in,,u',iout*rdt t a r m i n a t i o n , exclusive c o i ~ t r o l,per ator r e p l y , etc.
resiaent ovei-iay S u p r r v i . - o r r c u t i n a ( p d e n o t e s t h e <,VC nudosr of r o r ? i ~ n e ) . C i x r e s i c a n t rout,ir:e.,
ax
2,212
..;e;c.
:I ;dr
r',
of c a s e s ulc cue 01' ~ 5 e zi i ~ c c c . . ~i..e j~!j ., of c a s e s . On she o t k ~ e rban? s i x out. o _ ixt e e n ~ e ~ i a e rnot l t i n e c are ~ ) r a c ; i c a ~ i"ot y a c z e ~ o e ca t a l l . Loader ( r o u t i n e 43) ha, t h e h i g k e s t a.:1 Lvi',,' p e r i o a , a b o u t 3G,% of t h e o b s e r v a t i o r , ~,i.;.\;. (Loader i s a s e r i a l l y r o u t i n e < m d serve._ b o t h t h e S u p e r v i s o r anu t h e p r u i ~ l e mpro,.z'ams). \ 4 a i t i n g f o r Z ~ ~ d e r r' ae l e s ~ eta.;.~ . i ! ~ o u t 30,i of S ~ p e r v i s o r ' so v e r i v p e r i o c ( s e e 'Table 3 ) . T h i s l e a d s t o tkt. c:mc?u=ion t h a t Loader i s one of t h e b o t t l e n e c k s i n t h e system anu ao Z o a c s r s ~ o u l dbe mane r t - n t e rable.
If ::+(pi i d t h e s t a t e of program p a t time Tile f r e q u e n c y of acces,e. anu a c t i v i t y pel.t , t h e n t h e v e c t o r :t = ( S t ( p ) ) p e P i s t h e s c a - i o d j of o v e r l a y s carl oe u s e u t o iliake .;.:ic t e of p o s r a m ~f r 3 : n t h e . j e t P a t ;ime t . Tha ?race of t h e cecco:- St i s r e f e r r e a t o as t h e programs a c t i v i t y trace,PAT.
3f
ine
thdm r e s i u e n t , e.:,. i n t h i s system raoi t 53 ~iiioulu be .ciaae ?.e..i.cient.
Le1t:ction of t h e n u ~ b c rci ':~?aervi:or 0;: ra l y a r e a s i s an i m 2 o r t a n t yuo;tic>n. h!:ai; i n t e r r u p t s , a change v e c t o r n.qr;=s t St - ~ t i s of t h e t r a c e h a s shown t h a t t h e six j : c o u l d be i n t r o d u c e d where ~t i s t h e i n t e r - tco many f o r the nu;iiber c:' overoly .3.:.5.: v a l between t h e i n t e r r u p t s . The t r a c e o f gi::ieratec i n c:?e sy2Lem. FIFO i : n:.? ,.ai:,e n St i s r e f e r r e a t o as t h e Rro@a'ms a c t i v - s a t i s f a c t o r y a s o v e r l a y s rtialaccment a l z o Because
st c a n c h a n g i
i t - value> only a t
-
i t y change t r a c e , PACT. If the i n i t i a l s t a t e So i s f i x e d , t h e n PACT i s e q - i v a i e n t t b PAT. GO R e c o r d i n g PACT i r i v t e a a of P.44 ne.., pro:::(; be z s l i c c e s s f u l method. Fol' L:~c. i;g::te::i im-
c e r s t u d y t h e c o n t i n u o u s ob;orvation i n t s r v a l (axe a r i w e t i c t a p e ) m o ~ ? c sts cevcn o r n i g h t !lows ( w i t h an i n t e r r u p t r ? t e of abo u t 100 p e r s e c o n d ) when PACT i . 5 r e c o r d e d . When PAT i s r e c o r a e a t h e whole t a p ? i s f i l l e a within a a c r e
:u p e r v i
15 t?zougn 20 a i n u t e s .
-
Si;r?,, atior,hss that; more eff re21acLme.,w aitSorithns would reor;ce the r::~:,b;r of o i r c r l a y r , ; , e a . ~t o t h r e e o r f o u r . ...,L
+iJ.2
Andi,y:;i; o.f .:y.;te.r: PT..;r J.!!:~ ':able ohcws t 2 c ;:iilies ::-
+
:
-i;ie a c t i v -
, a::,,
i t y p e r i s a s f o r some ; t a t e . , s?, for L x p m : ~ ' : e a o z r / I n t e r p r e C,?r;, , Pt . ' r l ::t (Output- :,:.iter,, Trisi3 i.yjterr! (2E., +. 3r1 C3m?ilers,I,inK :lrx 2,ditor) md ,.:, neouisr. a,7t Lac f i , - s - t t h r e a F r o g r a n s a r e r c , i c e n t in
thi.. system m c I - c n e d u l e r i; l o a d e s z - r e -
A n a l g ~si
T a b l e s 1 mid 2 snow t h e f r e q u e n c i e s ?/ ( p ) L/ =a r e l a t i v e a z t l v i t y p e r i o d s @ i p ) f o r
.:c::ecl~ier
a c t 1 ; l i t y p e r i o d anolmta yo
9.2
of the cbservation time with about I@& taf i l e s a f i l e - t o - f i l e t r a n s i t i o n matrix i s ken by waiting Tor Loader's release.Schedu1- used. Fig.2 shows a graph of strong connece r makes intensive use of ~upervisor,which t i o n s between system f i l e s ,which i s based on one of such matrices. The t r v l s i t i o n mnttakes over liO.,o of the a c t i v i t y peri0d.A more d e t a i l e d analysis revealed t h a t if the r i x i s the source material f o r the n l g o r i t h most 9sed Supervisor zoutines were reenter- determining the optimal a l l o c a t i o n of system f i l e s on disks. Optimization of f i l e alioable t h i s f r a c t i o n would be reduced. cation signifj.cantly reduces the seek t i n e Expand and Polprint make useful work only ( by a f a c t o r of 7 through 10 f o r c e r t a i n 30A and 70% of i t s activi'itj periodo. The files) I/O-bound nature of system programs iot1ic:it e s t h a t optimization of 1/0 processes Two-Level Access t o System F i l e s , would significemtly increase i t s chnrscter- An 1/0 t r a c e was used f o r simulating a twoistics. l e v e l access t o system f i l e s . A buffer pool of several buffers of one disk track capacIt was found t h a t w i t ? : the exception of the i t y i s reserved i n core memory of the syyabove three system propams an average of tem. I f a requested block i s not in the 1.4 user programs are active during the pool the t r a c k containing i t i s pulled ini d l e t i n e a d , in one half of all cases,on- t o a buffer as in virtual memory. Fig. 3 i s 1y one program i s active. T h i s i s caused b r a p l o t of the number of disk accesses veri n s u f f i c i e n t s i z e o f the core memory f o r sus buffer pool size. Six b u f f e r s halve t h e the program 1.oading. number of disk accesses and t o t a l 1/0 t i n e .
.
CONCLUSIONS Analysis of the pro@gramsa c t i v i t y ha; shown the e f f e c t of the execution time of the I / O operations on the t o t a l operating system run time. A d e t a i l e d study was undertaken t o i d e n t i f y the I / O bottlenecks and optimize the 1/0 system. The raw material f o r the s t u Q was an 1/0 t r a c e obtained with the aid of ATOM f o r d i r e c t access devices. Some r e s u l t s of in2utioutput ana-
are given. System F i l e s Allocation. A s i g n i f i c a n t f r a c t i o n (30-50s on the ave-
rage) of access time f o r system f i l e s on head ~ovementdisks i s taken by the seek time. This time i s heavily dependent on f i l e a l l o c a t i o n on disks. The concurrently used f i l e s should be on separate volumes t o reduce the head movements. To determine the s t r u c t u r e of ccnnections between system
A trace-oriented ATOM software monitor i s
a powerful t o o l t o study computer systems. Programs a c t i v i t y t r a c e and Fnj?u%/output t r a c e give exhaustive data on the a c t i v i t y of the operating systea and input/output a c t i v i t y . The sampies of data obtained perm i t detection of bottlenecks i n the operat i n g system and t'aning the system parameters.
s i g n i f i c a n t l y improved i t s perfornance.The comparative a n a l p i s proved t h a t the systen throughput was increased by 25%. REFE3UANCS
1. Miller E.F., "Bibliography on Techniques of Computer Performance Analysis", Computer, Vo1.5, No.5, 1972.
Disc Operating System, Vols 1. 2 , ICL I???.
2 . J-Level
3 . Gurin N.N.,
Dashko V.E., Kogan Ta.A., Leman A . A . , "An I n v e s t i g a t i o n of t h e I n t e r a c t i o n of an Operating System p i t h Magnetic-Eisk Memory", Automat. Rein. Contr., Vol.35, No.2, B . 2 , 1974. Control
4. Aven O . I . , Arlazarov V.L., Gurin N.N., Dashko V.B., Kogan Ya.A., Leman A.A. "Operating Systems Dynamics", i n : Proc.
fl
Symp. on Theoretical and System Programming, Vol .I , Kishinev, 1974 in Russian Table 2
Fig.1 ATOM s t r u c t u r e : flow,
-+
control flow.
OUT
R
E
-E ,L,1-
SYS SY S
PHRCWK PHR 'CWK
SYSXEC
Fig.2,Colaecfiocs between system f i l e s . PF S I CFNT
Table 3
Table 4 S
EXPAND
FOLPRINT
TFIP1.S
SCHEflULEP
0 I Fit393
2
3
4 5
5 7
BmWR POOL SIZE
8
9
I0