You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 21:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Jun 04, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22824211388,20sleep00-21swapper/007:05:510
22777210986,16sleep30-21swapper/307:05:303
23307210897,6sleep20-21swapper/207:07:012
2337429982,12sleep10-21swapper/107:07:521
162782740,0sleep30-21swapper/309:51:093
302332730,0sleep30-21swapper/310:06:013
57752710,0sleep00-21swapper/007:45:120
2356899381,19cyclictest28083-21ssh11:45:110
200102320,0sleep20-21swapper/208:20:122
200102320,0sleep20-21swapper/208:20:112
2357199299,18cyclictest7654-21diskmemload11:40:133
2357199299,18cyclictest7654-21diskmemload11:40:123
99302230,2sleep337-21rcuc/312:33:083
2356999221,19cyclictest0-21swapper/108:20:121
2356999221,19cyclictest0-21swapper/108:20:111
61102210,0sleep20-21swapper/212:29:372
236292210,0sleep00-21swapper/012:13:560
2357199211,2cyclictest0-21swapper/307:20:113
2357099210,19cyclictest0-21swapper/208:35:112
2356899210,19cyclictest0-21swapper/008:40:110
2357099200,2cyclictest0-21swapper/208:45:102
2357099200,19cyclictest0-21swapper/209:05:112
2357099200,18cyclictest0-21swapper/208:00:142
2356999201,2cyclictest0-21swapper/112:10:121
2356999200,2cyclictest0-21swapper/107:20:101
2357199190,2cyclictest0-21swapper/312:10:123
23569991714,2cyclictest598-21kworker/u8:010:48:051
2357199161,13cyclictest2159-21munin-run10:45:013
23571991611,3cyclictest0-21swapper/308:00:143
2357199160,14cyclictest0-21swapper/311:02:163
2357199160,14cyclictest0-21swapper/308:05:053
2357099162,12cyclictest25001-21grep11:41:042
2357099162,12cyclictest25001-21grep11:41:032
2356999166,7cyclictest3688-21Xorg08:29:581
2356999166,7cyclictest3688-21Xorg08:29:581
23569991611,3cyclictest3635-21rm09:39:151
2356999161,13cyclictest23-21ksoftirqd/109:42:201
2356999160,2cyclictest29812-21ssh09:32:051
2356899161,3cyclictest0-21swapper/008:35:180
23568991612,2cyclictest0-21swapper/010:26:020
2356899160,14cyclictest7315-21munin-node0
2357199151,3cyclictest943-21users11:16:013
23570991512,2cyclictest0-21swapper/211:46:002
23570991510,3cyclictest30195-21ssh09:32:422
2357099150,13cyclictest11577-21kernelversion10:20:152
2357099150,13cyclictest0-21swapper/209:44:542
2357099150,13cyclictest0-21swapper/208:10:152
2356999152,7cyclictest0-21swapper/108:35:001
2356999152,10cyclictest0-21swapper/112:30:581
2356999151,3cyclictest0-21swapper/109:15:101
23569991512,2cyclictest9731-21kworker/u8:011:38:061
2356999150,13cyclictest30780-21if_eth010:40:141
2356999150,13cyclictest0-21swapper/110:15:101
2356999150,13cyclictest0-21swapper/109:15:001
2356899151,12cyclictest0-21swapper/009:11:050
23568991510,3cyclictest3918-21ssh10:45:470
2356899150,3cyclictest13923-21switchtime10:56:020
2356899150,3cyclictest0-21swapper/010:30:170
2356899150,2cyclictest0-21swapper/009:20:110
2357199149,3cyclictest14321-21sh10:23:263
23571991411,2cyclictest0-21swapper/309:00:163
23571991410,3cyclictest0-21swapper/311:55:113
23571991410,2cyclictest0-21swapper/311:21:273
2357199140,12cyclictest29527-21kworker/u8:007:26:013
2357199140,12cyclictest0-21swapper/309:26:053
2357099149,3cyclictest7654-21diskmemload11:53:232
23570991410,2cyclictest29525-21unixbench_singl08:41:022
2357099140,3cyclictest24006-21grep07:10:132
2357099140,2cyclictest0-21swapper/212:20:232
2357099140,13cyclictest0-21swapper/207:45:132
2357099140,12cyclictest14439-21fschecks_time08:05:142
2357099140,12cyclictest0-21swapper/211:58:212
2357099140,12cyclictest0-21swapper/210:10:142
2357099140,12cyclictest0-21swapper/209:30:002
2356999149,3cyclictest19032-21cut08:15:491
2356999142,7cyclictest31192-21copy11:15:001
2356999142,6cyclictest0-21swapper/107:50:001
23569991411,2cyclictest29251-21kworker/u8:211:21:051
23569991411,2cyclictest24735-21kworker/u8:211:56:051
23569991411,2cyclictest22779-21kworker/u8:210:24:051
23569991411,2cyclictest10150-21kworker/u8:012:07:041
2356999141,11cyclictest0-21swapper/107:55:121
2356999141,10cyclictest13706-21turbostat08:05:011
2356999140,2cyclictest0-21swapper/112:37:041
2356999140,12cyclictest9064-21apt-get09:45:061
2356999140,12cyclictest7654-21diskmemload12:03:441
2356999140,12cyclictest0-21swapper/108:35:051
2356899149,3cyclictest8378-21sh11:24:480
23568991411,2cyclictest0-21swapper/009:44:320
2356899140,2cyclictest0-21swapper/008:45:120
2356899140,12cyclictest15979-21ssh09:18:020
12332141,3sleep10-21swapper/111:50:171
9872130,2sleep00-21swapper/010:10:070
62712130,2sleep10-21swapper/112:29:531
3772130,2sleep10-21swapper/108:50:161
2357199139,2cyclictest0-21swapper/309:10:123
2357199138,3cyclictest1046-21rm10:10:113
23571991310,2cyclictest0-21swapper/310:50:133
23571991310,2cyclictest0-21swapper/309:30:143
2357199130,2cyclictest7654-21diskmemload09:40:013
2357199130,2cyclictest21579-21ssh09:56:563
2357199130,2cyclictest0-21swapper/309:46:433
2357199130,2cyclictest0-21swapper/308:55:153
2357199130,11cyclictest0-21swapper/312:27:583
2357199130,11cyclictest0-21swapper/312:07:273
2357099139,2cyclictest3649-21snmpd10:28:072
23570991310,2cyclictest24538-21ssh10:34:212
23570991310,2cyclictest0-21swapper/212:37:312
23570991310,2cyclictest0-21swapper/212:13:172
23570991310,2cyclictest0-21swapper/212:05:282
23570991310,2cyclictest0-21swapper/211:31:172
23570991310,2cyclictest0-21swapper/211:26:182
23570991310,2cyclictest0-21swapper/210:56:292
23570991310,2cyclictest0-21swapper/209:20:122
23570991310,2cyclictest0-21swapper/209:11:032
23570991310,2cyclictest0-21swapper/209:00:152
2357099130,2cyclictest3728-21runrttasks09:50:082
2357099130,2cyclictest0-21swapper/212:30:582
2357099130,2cyclictest0-21swapper/212:16:072
2357099130,2cyclictest0-21swapper/210:38:102
2357099130,2cyclictest0-21swapper/210:07:012
2357099130,2cyclictest0-21swapper/208:56:012
2357099130,2cyclictest0-21swapper/208:15:152
2357099130,2cyclictest0-21swapper/207:15:122
2357099130,12cyclictest0-21swapper/211:08:032
2357099130,12cyclictest0-21swapper/210:15:102
2357099130,12cyclictest0-21swapper/210:00:032
2357099130,11cyclictest7654-21diskmemload10:46:532
2357099130,11cyclictest29309-21ssh11:12:092
2357099130,11cyclictest14033-21ssh09:15:392
2356999138,3cyclictest0-21swapper/110:34:561
2356999131,10cyclictest26257-21python12:16:011
2356999131,10cyclictest0-21swapper/107:10:151
23569991310,2cyclictest9630-21kworker/u8:008:05:041
23569991310,2cyclictest6155-21kworker/u8:110:53:041
23569991310,2cyclictest2485-21kworker/u8:107:51:041
2356999130,11cyclictest0-21swapper/110:05:291
2356999130,11cyclictest0-21swapper/107:40:291
2356899138,3cyclictest0-21swapper/009:56:580
2356899132,6cyclictest0-21swapper/012:20:020
23568991310,2cyclictest7654-21diskmemload11:32:220
23568991310,2cyclictest0-21swapper/011:50:220
23568991310,2cyclictest0-21swapper/009:45:140
2356899130,2cyclictest0-21swapper/011:17:130
2356899130,2cyclictest0-21swapper/010:00:150
2356899130,1cyclictest0-21swapper/012:00:120
2356899130,1cyclictest0-21swapper/010:43:220
2356899130,1cyclictest0-21swapper/010:22:130
2356899130,12cyclictest0-21swapper/011:36:230
2356899130,12cyclictest0-21swapper/011:00:420
2356899130,11cyclictest3126-21ssh12:25:400
2356899130,11cyclictest27757-21ssh10:36:500
2356899130,11cyclictest27669-21fschecks_count09:30:140
2356899130,11cyclictest0-21swapper/012:35:380
2356899130,11cyclictest0-21swapper/012:06:110
276142120,2sleep30-21swapper/312:17:413
2357199129,2cyclictest0-21swapper/312:35:553
2357199129,2cyclictest0-21swapper/311:31:043
2357199129,2cyclictest0-21swapper/310:35:103
2357199127,3cyclictest0-21swapper/312:03:273
2357199122,6cyclictest0-21swapper/307:15:013
2357199121,9cyclictest7618-40update-apt-xapi07:49:513
2357199120,2cyclictest0-21swapper/312:20:353
2357199120,2cyclictest0-21swapper/311:36:303
2357199120,2cyclictest0-21swapper/310:25:033
2357199120,2cyclictest0-21swapper/307:16:023
2357199120,11cyclictest0-21swapper/311:50:153
2357199120,11cyclictest0-21swapper/310:45:163
2357199120,11cyclictest0-21swapper/307:40:133
2357199120,10cyclictest0-21swapper/309:19:353
2357099129,2cyclictest0-21swapper/211:20:472
2357099129,2cyclictest0-21swapper/210:43:462
2357099129,2cyclictest0-21swapper/209:37:392
2357099129,2cyclictest0-21swapper/208:30:132
2357099129,2cyclictest0-21swapper/207:50:142
2357099122,7cyclictest0-21swapper/208:28:582
2357099122,7cyclictest0-21swapper/208:28:582
2357099121,8cyclictest0-21swapper/211:15:012
2357099120,2cyclictest0-21swapper/209:57:052
2357099120,2cyclictest0-21swapper/209:46:432
2357099120,11cyclictest0-21swapper/212:00:202
2357099120,11cyclictest0-21swapper/211:35:482
2357099120,11cyclictest0-21swapper/211:02:502
2357099120,11cyclictest0-21swapper/210:50:072
2356999129,2cyclictest0-21swapper/109:28:041
2356999129,2cyclictest0-21swapper/109:25:001
2356999129,2cyclictest0-21swapper/107:15:141
2356999127,3cyclictest24427-21grep10:00:141
2356999127,3cyclictest12500-21grep10:55:131
2356999121,9cyclictest2554-21ntp_states08:55:161
2356999121,9cyclictest0-21swapper/111:25:111
2356999121,9cyclictest0-21swapper/109:55:151
2356999121,3cyclictest0-21swapper/107:30:131
2356999120,2cyclictest7654-21diskmemload11:47:041
2356999120,2cyclictest7654-21diskmemload09:50:161
2356999120,2cyclictest0-21swapper/111:17:341
2356999120,2cyclictest0-21swapper/111:06:241
2356999120,2cyclictest0-21swapper/109:05:291
2356999120,11cyclictest0-21swapper/111:40:131
2356999120,11cyclictest0-21swapper/111:40:131
2356999120,11cyclictest0-21swapper/111:30:291
2356899129,2cyclictest0-21swapper/010:53:440
2356899129,2cyclictest0-21swapper/009:54:150
2356899129,2cyclictest0-21swapper/007:26:010
2356899123,5cyclictest0-21swapper/010:06:000
2356899122,8cyclictest0-21swapper/008:06:010
2356899122,6cyclictest0-21swapper/007:25:000
2356899121,6cyclictest0-21swapper/010:15:000
2356899120,2cyclictest0-21swapper/011:41:230
2356899120,2cyclictest0-21swapper/011:41:230
2356899120,2cyclictest0-21swapper/011:11:410
2356899120,1cyclictest0-21swapper/009:37:230
2356899120,11cyclictest0-21swapper/012:30:340
2356899120,11cyclictest0-21swapper/012:17:220
2356899120,11cyclictest0-21swapper/011:55:050
2356899120,11cyclictest0-21swapper/011:26:390
2356899120,11cyclictest0-21swapper/011:05:420
2356899120,11cyclictest0-21swapper/009:25:040
2356899120,11cyclictest0-21swapper/007:50:160
2356899120,11cyclictest0-21swapper/007:15:160
294462110,1sleep1221ktimersoftd/112:20:111
2357199118,2cyclictest7654-21diskmemload10:57:493
2357199118,2cyclictest7654-21diskmemload09:20:103
2357199118,2cyclictest0-21swapper/311:45:263
2357199118,2cyclictest0-21swapper/311:10:033
2357199118,2cyclictest0-21swapper/307:35:153
2357199116,3cyclictest6537-21grep10:15:143
2357199111,6cyclictest0-21swapper/308:45:003
2357199110,2cyclictest7654-21diskmemload10:32:193
2357199110,2cyclictest0-21swapper/311:07:123
2357199110,10cyclictest0-21swapper/311:25:193
2357199110,10cyclictest0-21swapper/310:02:103
2357199110,10cyclictest0-21swapper/307:55:293
2357099118,2cyclictest0-21swapper/207:40:282
2356999118,2cyclictest7654-21diskmemload10:25:461
2356999118,2cyclictest2485-21kworker/u8:108:41:051
2356999118,2cyclictest0-21swapper/110:11:071
2356999116,3cyclictest0-21swapper/110:35:151
2356999111,8cyclictest17065-21apt-get11:00:091
2356999111,8cyclictest0-21swapper/109:00:141
2356999111,6cyclictest0-21swapper/108:45:591
2356999110,9cyclictest0-21swapper/107:25:181
2356999110,3cyclictest0-21swapper/108:10:151
2356899117,2cyclictest0-21swapper/008:50:120
2356899116,3cyclictest17839-21cat08:15:000
2356899111,7cyclictest0-21swapper/008:19:020
2356899111,6cyclictest0-21swapper/008:57:520
2357199105,3cyclictest32711-21cat07:30:173
2357199105,3cyclictest24693-21iostat_ios08:30:143
2357199105,3cyclictest20307-21df_abs08:20:133
2357199105,3cyclictest20307-21df_abs08:20:133
2357199105,3cyclictest18597-21if_eth008:15:143
2357199105,3cyclictest1702-21sh09:36:183
2357199103,6cyclictest0-21swapper/308:26:013
2357199103,6cyclictest0-21swapper/308:26:003
2357199102,6cyclictest0-21swapper/308:11:023
2357099102,7cyclictest0-21swapper/207:55:012
2357099100,7cyclictest0-21swapper/208:53:012
2357099100,7cyclictest0-21swapper/207:26:012
2357099100,7cyclictest0-21swapper/207:20:592
2356999100,8cyclictest0-21swapper/107:36:021
2356899107,2cyclictest0-21swapper/007:30:300
2356899107,2cyclictest0-21swapper/007:11:020
2356899105,3cyclictest22870-21ntp_kernel_err08:25:160
2356899105,3cyclictest22870-21ntp_kernel_err08:25:160
2356899103,2cyclictest13362-21sed08:01:040
2356899102,6cyclictest0-21swapper/009:02:520
2356899101,7cyclictest0-21swapper/007:42:360
235719994,3cyclictest32547-21fschecks_count08:50:143
235719992,6cyclictest0-21swapper/308:36:013
235719991,6cyclictest3152-21nscd09:10:003
235719991,6cyclictest31512-21grep08:46:013
235709991,7cyclictest0-21swapper/207:30:012
235689994,3cyclictest25879-21sed08:35:010
235689994,3cyclictest1569-21aten2.4-expect07:35:100
235689994,3cyclictest10473-21http_loadtime07:55:140
235689993,4cyclictest20810-21grep08:20:170
235689993,4cyclictest20810-21grep08:20:170
235719985,2cyclictest0-21swapper/307:50:003
235709980,5cyclictest0-21swapper/207:37:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional