You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 22:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Fri Jun 12, 2026 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7036732243175,22sleep20-21swapper/207:07:162
7037132240178,19sleep40-21swapper/407:07:504
7035582238175,19sleep60-21swapper/607:05:356
7035802224187,24sleep10-21swapper/107:05:541
7037272219184,24sleep00-21swapper/007:08:020
7035642219185,22sleep30-21swapper/307:05:403
7035862214184,19sleep70-21swapper/707:06:007
7009962214182,20sleep50-21swapper/507:05:035
70407799319,4cyclictest0-21swapper/511:19:295
70407799308,4cyclictest0-21swapper/510:57:315
70407799297,4cyclictest0-21swapper/511:30:285
70407799297,4cyclictest0-21swapper/509:51:375
70407799297,4cyclictest0-21swapper/508:45:435
70407799297,4cyclictest0-21swapper/508:23:455
70407199291,22cyclictest0-21swapper/207:35:002
70407799286,4cyclictest0-21swapper/511:08:305
70407799286,4cyclictest0-21swapper/510:46:325
70407799286,4cyclictest0-21swapper/509:40:385
70407799286,4cyclictest0-21swapper/508:34:445
70407799286,4cyclictest0-21swapper/508:01:475
70407799286,4cyclictest0-21swapper/507:39:495
70407799286,4cyclictest0-21swapper/507:17:515
70407199280,22cyclictest840451-21sendmail11:00:002
704066992825,2cyclictest740181-21munin-plugin-st08:10:011
70408399272,1cyclictest0-21swapper/708:55:007
70408399270,26cyclictest722431-21munin-run07:40:017
70407799279,0cyclictest0-21swapper/508:12:465
70408399260,25cyclictest754912-21idleruntime-cro08:35:007
70407799269,0cyclictest0-21swapper/510:13:355
70407799268,0cyclictest0-21swapper/512:25:235
70407799268,0cyclictest0-21swapper/510:35:335
70407799263,22cyclictest711ktimers/509:05:125
70407299260,25cyclictest0-21swapper/311:20:183
70407199260,25cyclictest0-21swapper/212:00:112
70406699260,25cyclictest1-21systemd07:40:011
704083992522,3cyclictest3422186-21systemd-journal10:00:007
70407999250,3cyclictest812668-21grep10:10:166
70407999250,24cyclictest0-21swapper/611:20:186
70407799257,0cyclictest0-21swapper/511:52:265
70407799256,18cyclictest0-21swapper/509:29:395
70407499250,24cyclictest0-21swapper/409:15:134
704066992523,1cyclictest0-21swapper/110:00:181
704066992522,3cyclictest0-21swapper/110:25:101
704066992522,3cyclictest0-21swapper/110:25:101
704066992521,3cyclictest0-21swapper/110:05:121
70406699250,24cyclictest0-21swapper/107:40:031
70408399240,24cyclictest734290-21perf08:00:017
70408399240,24cyclictest0-21swapper/711:10:187
70407999240,23cyclictest872890-21latency_hist11:55:016
70407999240,23cyclictest708099-21apt-get07:15:136
70407999240,0cyclictest0-21swapper/612:15:126
70407799246,18cyclictest0-21swapper/512:36:225
70407799246,0cyclictest0-21swapper/512:14:245
70407799246,0cyclictest0-21swapper/511:41:275
70407799246,0cyclictest0-21swapper/510:24:345
70407799246,0cyclictest0-21swapper/510:02:365
70407799246,0cyclictest0-21swapper/507:50:485
70407799240,23cyclictest760820-21grep08:45:005
70407499240,23cyclictest0-21swapper/410:10:164
70407299240,23cyclictest0-21swapper/311:45:183
70407299240,0cyclictest0-21swapper/312:15:123
704066992422,1cyclictest0-21swapper/110:00:001
70406599240,23cyclictest719478-21awk07:35:000
704083992322,1cyclictest846330-21sh11:10:007
70408399230,23cyclictest0-21swapper/711:40:187
704079992322,1cyclictest791rcuc/611:25:116
704079992321,1cyclictest891046-21apt-get12:25:116
704079992321,1cyclictest0-21swapper/607:20:126
70407999230,22cyclictest774357-21ntpq09:05:186
70407999230,22cyclictest735990-21ntpq08:00:176
70407999230,22cyclictest731762-21apt-get07:55:106
70407999230,22cyclictest0-21swapper/611:45:186
70407999230,22cyclictest0-21swapper/611:15:106
70407999230,22cyclictest0-21swapper/608:40:006
704077992323,0cyclictest0-21swapper/509:15:135
704077992322,1cyclictest0-21swapper/508:25:125
70407799230,22cyclictest714007-21apt-get07:25:165
70407799230,22cyclictest0-21swapper/509:30:185
70407799230,1cyclictest893988-21apt-get12:30:115
70407499230,22cyclictest859883-21ntpq11:30:174
70407499230,22cyclictest766758-21908:55:004
70407499230,22cyclictest757872-21perf08:40:004
70407499230,22cyclictest0-21swapper/412:30:104
70407499230,1cyclictest0-21swapper/410:55:004
704072992321,1cyclictest0-21swapper/312:25:113
704072992321,1cyclictest0-21swapper/309:35:113
704072992321,1cyclictest0-21swapper/309:25:133
704072992321,1cyclictest0-21swapper/309:05:123
70407299230,22cyclictest846374-21http11:10:003
70407299230,22cyclictest815610-21ntpq10:15:173
70407299230,22cyclictest728823-21apt-get07:50:133
70407299230,22cyclictest0-21swapper/311:55:013
70407299230,22cyclictest0-21swapper/311:15:103
70407299230,22cyclictest0-21swapper/310:25:123
70407299230,22cyclictest0-21swapper/310:25:113
70407299230,22cyclictest0-21swapper/309:30:123
70407299230,1cyclictest802530-21apt-get09:55:123
70407299230,1cyclictest746511-21apt-get08:20:123
70407299230,1cyclictest0-21swapper/311:15:003
70407199230,23cyclictest887651-21idleruntime-cro12:20:002
70407199230,22cyclictest0-21swapper/210:00:122
70407199230,22cyclictest0-21swapper/208:30:122
70406699230,22cyclictest0-21swapper/110:35:001
70406699230,22cyclictest0-21swapper/110:35:001
70406699230,22cyclictest0-21swapper/109:30:121
70406699230,22cyclictest0-21swapper/108:25:001
70406699230,22cyclictest0-21swapper/108:15:121
704065992322,1cyclictest731325-21cron07:55:010
704065992319,3cyclictest813884-21munin-plugin-st10:15:000
70406599230,23cyclictest0-21swapper/010:45:110
70406599230,22cyclictest0-21swapper/011:25:100
70406599230,22cyclictest0-21swapper/011:10:030
704083992221,1cyclictest799592-21apt-get09:50:147
704083992221,1cyclictest781919-21apt-get09:20:127
704083992221,1cyclictest773066-21apt-get09:05:127
70408399220,22cyclictest770125-21apt-get09:00:137
70408399220,21cyclictest888107-21apt-get12:20:127
70408399220,21cyclictest867444-21apt-get11:45:127
70408399220,21cyclictest766694-21apt-get08:55:037
70408399220,21cyclictest725847-21apt-get07:45:127
70408399220,21cyclictest0-21swapper/711:50:137
70408399220,21cyclictest0-21swapper/711:35:127
70408399220,21cyclictest0-21swapper/710:35:127
70408399220,1cyclictest796649-21apt-get09:45:127
70408399220,0cyclictest0-21swapper/711:55:027
70408399220,0cyclictest0-21swapper/708:45:127
704079992222,0cyclictest0-21swapper/611:40:126
704079992220,1cyclictest742600-21cat08:10:256
704079992220,1cyclictest740180-21munin-run08:10:016
704079992220,1cyclictest0-21swapper/610:05:126
704079992220,1cyclictest0-21swapper/608:45:126
704079992218,3cyclictest861120-21turbostat11:35:006
70407999220,21cyclictest837893-21apt-get10:55:136
70407999220,21cyclictest796218-21idleruntime-cro09:45:006
70407999220,21cyclictest747835-21ntpq08:20:196
70407999220,21cyclictest0-21swapper/610:25:116
70407999220,21cyclictest0-21swapper/610:25:116
70407999220,21cyclictest0-21swapper/609:30:126
70407999220,21cyclictest0-21swapper/608:30:126
70407999220,1cyclictest849316-21turbostat11:15:006
70407999220,1cyclictest837475-21perf10:55:006
704077992221,1cyclictest790747-21apt-get09:35:115
704077992221,1cyclictest0-21swapper/508:40:005
704077992220,1cyclictest890621-21munin-run12:25:005
704077992220,1cyclictest846805-21apt-get11:10:125
70407799220,22cyclictest0-21swapper/509:55:115
70407799220,21cyclictest855650-21apt-get11:25:105
70407799220,21cyclictest701rcuc/511:25:005
70407799220,21cyclictest0-21swapper/509:10:125
70407799220,21cyclictest0-21swapper/507:30:155
70407799220,1cyclictest834952-21apt-get10:50:125
70407799220,1cyclictest809822-21ntpq10:05:195
704074992221,1cyclictest864505-21apt-get11:40:124
704074992221,1cyclictest0-21swapper/411:05:094
704074992221,1cyclictest0-21swapper/408:00:114
704074992220,1cyclictest848087-21awk11:10:174
704074992220,1cyclictest776006-21apt-get09:10:124
704074992220,1cyclictest0-21swapper/412:05:114
70407499220,21cyclictest840404-21apt-get11:00:004
70407499220,21cyclictest0-21swapper/411:00:134
70407499220,21cyclictest0-21swapper/410:30:094
70407499220,21cyclictest0-21swapper/410:30:094
70407499220,21cyclictest0-21swapper/410:20:114
70407499220,21cyclictest0-21swapper/410:00:114
70407499220,21cyclictest0-21swapper/409:40:124
70407499220,21cyclictest0-21swapper/407:50:014
70407499220,0cyclictest0-21swapper/408:20:124
704072992222,0cyclictest0-21swapper/311:40:123
704072992221,1cyclictest0-21swapper/311:55:113
704072992221,1cyclictest0-21swapper/311:30:113
704072992221,1cyclictest0-21swapper/309:00:133
704072992219,2cyclictest793709-21apt-get09:40:113
704072992215,3cyclictest0-21swapper/307:20:003
70407299220,21cyclictest840890-21apt-get11:00:133
70407299220,21cyclictest829071-21apt-get10:40:113
70407299220,21cyclictest0-21swapper/308:10:143
70407299220,21cyclictest0-21swapper/308:05:143
70407299220,1cyclictest722908-21apt-get07:40:143
70407299220,1cyclictest521rcuc/308:40:003
70407299220,1cyclictest0-21swapper/309:45:123
70407299220,0cyclictest0-21swapper/309:15:123
704071992221,1cyclictest810947-21munin-run10:10:012
704071992221,1cyclictest746069-21munin-run08:20:012
704071992221,1cyclictest0-21swapper/212:25:112
704071992221,1cyclictest0-21swapper/210:40:172
704071992217,4cyclictest789-21dbus-daemon09:20:002
70407199220,22cyclictest872892-21apt-get11:55:032
70407199220,22cyclictest0-21swapper/212:35:102
70407199220,22cyclictest0-21swapper/211:50:002
70407199220,21cyclictest0-21swapper/208:50:132
70407199220,21cyclictest0-21swapper/208:00:122
70407199220,1cyclictest0-21swapper/211:00:022
70407199220,1cyclictest0-21swapper/209:50:002
70407199220,0cyclictest0-21swapper/212:05:112
70407199220,0cyclictest0-21swapper/209:35:162
70407199220,0cyclictest0-21swapper/209:10:122
70407199220,0cyclictest0-21swapper/208:55:032
704066992222,0cyclictest0-21swapper/110:35:121
704066992221,1cyclictest0-21swapper/111:45:201
704066992221,1cyclictest0-21swapper/108:45:121
704066992221,1cyclictest0-21swapper/108:10:141
70406699221,0cyclictest0-21swapper/111:10:031
70406699220,21cyclictest0-21swapper/110:50:131
70406699220,21cyclictest0-21swapper/109:40:121
70406699220,21cyclictest0-21swapper/109:10:121
70406699220,21cyclictest0-21swapper/108:50:131
70406699220,21cyclictest0-21swapper/108:25:171
70406699220,1cyclictest875888-21systemctl12:00:001
70406699220,1cyclictest0-21swapper/112:30:111
70406699220,14cyclictest0-21swapper/111:30:271
704065992221,1cyclictest887665-21munin-run12:20:000
704065992221,1cyclictest797915-21ntpq09:45:180
704065992221,1cyclictest784860-21apt-get09:25:130
704065992221,1cyclictest0-21swapper/011:50:140
704065992221,1cyclictest0-21swapper/010:25:000
70406599220,22cyclictest875875-21turbostat12:00:000
70406599220,22cyclictest842223-21awk11:00:200
70406599220,22cyclictest0-21swapper/008:55:000
70406599220,22cyclictest0-21swapper/007:20:120
70406599220,21cyclictest808430-21apt-get10:05:120
70406599220,21cyclictest0-21swapper/011:35:110
70406599220,21cyclictest0-21swapper/009:50:140
70406599220,21cyclictest0-21swapper/009:00:130
70406599220,21cyclictest0-21swapper/008:30:120
70406599220,21cyclictest0-21swapper/008:00:110
70406599220,1cyclictest0-21swapper/011:40:120
704083992121,0cyclictest0-21swapper/710:30:097
704083992121,0cyclictest0-21swapper/710:30:097
704083992121,0cyclictest0-21swapper/707:10:117
704083992120,1cyclictest746511-21apt-get08:20:127
704083992120,1cyclictest0-21swapper/710:40:127
70408399210,21cyclictest820216-21apt-get10:25:117
70408399210,21cyclictest820216-21apt-get10:25:117
70408399210,21cyclictest0-21swapper/711:00:137
70408399210,21cyclictest0-21swapper/707:40:147
70408399210,20cyclictest0-21swapper/711:25:107
70408399210,20cyclictest0-21swapper/709:25:137
70408399210,1cyclictest0-21swapper/708:00:117
70408399210,0cyclictest0-21swapper/708:25:187
70408399210,0cyclictest0-21swapper/707:25:157
704079992121,0cyclictest0-21swapper/612:00:126
704079992121,0cyclictest0-21swapper/609:25:126
704079992120,1cyclictest0-21swapper/611:55:116
704079992117,3cyclictest805089-21idleruntime-cro10:00:006
70407999210,20cyclictest0-21swapper/612:35:106
70407999210,20cyclictest0-21swapper/607:50:136
70407999210,1cyclictest861543-21apt-get11:35:126
70407999210,0cyclictest0-21swapper/610:15:176
70407999210,0cyclictest0-21swapper/609:15:126
704077992121,0cyclictest0-21swapper/508:55:115
70407799210,20cyclictest823157-21apt-get10:30:105
70407799210,20cyclictest823157-21apt-get10:30:105
70407799210,20cyclictest743545-21apt-get08:15:115
70407799210,20cyclictest0-21swapper/511:00:145
70407799210,20cyclictest0-21swapper/508:50:205
704074992121,0cyclictest864064-21munin-run11:40:004
704074992121,0cyclictest0-21swapper/412:15:124
704074992121,0cyclictest0-21swapper/411:50:134
704074992121,0cyclictest0-21swapper/410:15:124
704074992120,1cyclictest876321-21apt-get12:00:134
704074992120,1cyclictest753695-21ntpq08:30:184
704074992120,1cyclictest0-21swapper/407:15:134
70407499210,20cyclictest0-21swapper/412:10:104
70407499210,20cyclictest0-21swapper/408:55:114
70407499210,0cyclictest0-21swapper/411:45:184
70407499210,0cyclictest0-21swapper/409:05:124
70407499210,0cyclictest0-21swapper/408:40:134
70407499210,0cyclictest0-21swapper/407:35:144
704072992121,0cyclictest0-21swapper/312:00:123
704072992121,0cyclictest0-21swapper/311:25:113
704072992121,0cyclictest0-21swapper/307:20:123
704072992120,1cyclictest0-21swapper/310:05:123
704072992120,1cyclictest0-21swapper/309:10:123
704072992120,0cyclictest0-21swapper/308:40:133
70407299210,0cyclictest0-21swapper/308:00:173
70407299210,0cyclictest0-21swapper/307:55:113
70407299210,0cyclictest0-21swapper/307:35:143
704071992121,0cyclictest0-21swapper/212:20:112
704071992121,0cyclictest0-21swapper/212:10:102
704071992121,0cyclictest0-21swapper/210:30:112
704071992121,0cyclictest0-21swapper/210:30:102
704071992120,1cyclictest0-21swapper/210:30:002
704071992120,1cyclictest0-21swapper/210:30:002
704071992120,1cyclictest0-21swapper/209:50:202
70407199210,21cyclictest708099-21apt-get07:15:122
70407199210,21cyclictest0-21swapper/210:20:102
70407199210,21cyclictest0-21swapper/209:30:202
70407199210,21cyclictest0-21swapper/208:25:122
70407199210,21cyclictest0-21swapper/207:40:022
70407199210,0cyclictest0-21swapper/210:10:162
70407199210,0cyclictest0-21swapper/207:25:152
704066992121,0cyclictest0-21swapper/111:15:101
704066992120,1cyclictest0-21swapper/111:40:121
704066992118,2cyclictest0-21swapper/111:40:001
704066992118,2cyclictest0-21swapper/108:35:121
70406699210,20cyclictest0-21swapper/111:00:191
70406699210,0cyclictest0-21swapper/108:40:191
704065992121,0cyclictest0-21swapper/012:35:150
704065992121,0cyclictest0-21swapper/012:30:110
704065992121,0cyclictest0-21swapper/011:10:010
704065992121,0cyclictest0-21swapper/009:55:120
704065992121,0cyclictest0-21swapper/008:55:020
704065992121,0cyclictest0-21swapper/008:40:130
704065992120,1cyclictest727230-21ntp_states07:45:200
704065992120,1cyclictest0-21swapper/012:05:110
70406599210,21cyclictest840464-21sqv11:00:000
70406599210,21cyclictest816875-21sendmail10:20:000
70406599210,21cyclictest0-21swapper/009:05:130
70406599210,0cyclictest0-21swapper/012:20:130
70406599210,0cyclictest0-21swapper/012:10:100
704083992020,0cyclictest0-21swapper/710:45:127
704083992020,0cyclictest0-21swapper/710:15:127
704083992020,0cyclictest0-21swapper/709:10:127
704083992020,0cyclictest0-21swapper/708:40:137
704083992020,0cyclictest0-21swapper/708:10:147
704083992020,0cyclictest0-21swapper/708:05:137
704083992020,0cyclictest0-21swapper/707:50:137
704083992020,0cyclictest0-21swapper/707:20:137
704083992019,1cyclictest896939-21apt-get12:35:107
704083992019,1cyclictest805490-21apt-get10:00:127
70408399200,0cyclictest0-21swapper/712:25:117
704079992020,0cyclictest0-21swapper/609:35:116
704079992020,0cyclictest0-21swapper/609:10:126
704079992020,0cyclictest0-21swapper/609:00:136
704079992019,1cyclictest825688-21munin-run10:35:006
704079992019,1cyclictest825688-21munin-run10:35:006
704079992019,0cyclictest0-21swapper/608:40:136
70407999200,0cyclictest0-21swapper/610:40:116
70407999200,0cyclictest0-21swapper/607:35:146
704077992020,0cyclictest885140-21apt-get12:15:125
704077992020,0cyclictest0-21swapper/509:45:125
704077992020,0cyclictest0-21swapper/507:55:105
704077992019,1cyclictest728360-21ls07:50:015
704077992019,1cyclictest712432-21ntpq07:20:195
704077992018,1cyclictest814311-21apt-get10:15:125
70407799200,0cyclictest0-21swapper/507:10:115
704074992020,0cyclictest704400-21apt-get07:10:124
704074992020,0cyclictest0-21swapper/411:25:104
704074992020,0cyclictest0-21swapper/410:45:124
704074992020,0cyclictest0-21swapper/410:40:114
704074992020,0cyclictest0-21swapper/409:55:134
704074992020,0cyclictest0-21swapper/409:45:124
704074992020,0cyclictest0-21swapper/409:30:184
704074992020,0cyclictest0-21swapper/407:40:144
704074992019,1cyclictest762630-21ntpq08:45:204
704074992019,1cyclictest0-21swapper/409:25:134
70407499200,20cyclictest0-21swapper/412:20:114
70407499200,1cyclictest0-21swapper/412:35:174
70407499200,0cyclictest0-21swapper/411:20:124
70407499200,0cyclictest0-21swapper/409:50:144
70407499200,0cyclictest0-21swapper/408:25:124
70407499200,0cyclictest0-21swapper/407:50:034
70407499200,0cyclictest0-21swapper/407:20:194
704072992020,0cyclictest0-21swapper/310:35:003
704072992020,0cyclictest0-21swapper/310:35:003
704072992020,0cyclictest0-21swapper/308:45:123
704072992019,1cyclictest767160-21apt-get08:55:113
704072992019,1cyclictest0-21swapper/307:25:213
704072992018,1cyclictest0-21swapper/312:20:123
704072992018,1cyclictest0-21swapper/312:05:183
704072992018,1cyclictest0-21swapper/310:55:123
704071992020,0cyclictest0-21swapper/212:30:182
704071992020,0cyclictest0-21swapper/211:50:202
704071992020,0cyclictest0-21swapper/211:40:132
704071992020,0cyclictest0-21swapper/211:30:112
704071992020,0cyclictest0-21swapper/211:25:112
704071992020,0cyclictest0-21swapper/211:15:092
704071992020,0cyclictest0-21swapper/211:10:022
704071992020,0cyclictest0-21swapper/209:20:122
704071992020,0cyclictest0-21swapper/208:45:132
704071992020,0cyclictest0-21swapper/207:55:152
704071992019,1cyclictest846391-21systemd-run11:10:002
704071992019,1cyclictest0-21swapper/207:45:182
70407199200,20cyclictest0-21swapper/208:40:132
70407199200,20cyclictest0-21swapper/207:10:172
704066992020,0cyclictest0-21swapper/112:10:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional