You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 08:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Jun 04, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24193212298,18sleep00-21swapper/019:09:490
241192114103,6sleep30-21swapper/319:08:523
24123211093,12sleep20-21swapper/219:08:552
23497210796,6sleep10-21swapper/119:05:531
225702900,0sleep20-21swapper/222:16:212
295792770,0sleep0101ktimersoftd/021:50:180
17892750,0sleep00-21swapper/021:21:330
278012740,0sleep10-21swapper/121:49:161
119662710,0sleep10-21swapper/122:05:261
251552680,0sleep00-21swapper/022:20:000
24236993717,18cyclictest11-21rcuc/022:45:100
270332290,1sleep00-21swapper/019:20:000
2423799260,24cyclictest0-21swapper/100:00:091
282912250,1sleep121-21rcuc/122:56:011
198462240,1sleep323401-21diskmemload23:55:113
24239992217,3cyclictest18968-21ssh21:40:103
302592200,1sleep10-21swapper/121:17:521
24239992017,2cyclictest0-21swapper/319:10:113
4452180,0sleep20-21swapper/221:54:412
305692180,2sleep337-21rcuc/319:30:143
2423899180,16cyclictest0-21swapper/222:40:102
24237991714,2cyclictest7908-21kworker/u8:200:17:051
24237991714,2cyclictest3794-21kworker/u8:123:14:011
24237991714,2cyclictest23414-21kworker/u8:122:32:041
323072160,1sleep10-21swapper/121:53:441
2423999161,3cyclictest12964-21sensors_temp00:21:013
2423999161,3cyclictest0-21swapper/323:50:143
2423999161,2cyclictest0-21swapper/321:56:593
24239991611,3cyclictest23401-21diskmemload22:50:183
24238991610,3cyclictest7380-21ssh22:00:472
2423899160,14cyclictest0-21swapper/223:35:132
2423899160,14cyclictest0-21swapper/221:47:502
2423899160,14cyclictest0-21swapper/200:25:122
2423899160,13cyclictest0-21swapper/222:55:002
24237991613,2cyclictest7954-21kworker/u8:120:55:051
24237991613,2cyclictest6143-21kworker/u8:222:10:051
24237991613,2cyclictest6143-21kworker/u8:222:04:051
24237991613,2cyclictest5426-21kworker/u8:023:00:051
24237991613,2cyclictest28831-21kworker/u8:020:03:041
2423799160,11cyclictest0-21swapper/121:11:051
24239991510,3cyclictest0-21swapper/322:05:003
2423899151,3cyclictest29374-21find23:31:002
24238991512,2cyclictest0-21swapper/200:30:292
2423899151,12cyclictest24235-21cyclictest21:00:062
2423899151,12cyclictest15270-21ssh00:24:092
24238991510,3cyclictest11321-21sh23:45:442
2423799152,7cyclictest0-21swapper/119:25:001
2423799151,3cyclictest1482-21cut23:35:401
24237991512,2cyclictest28831-21kworker/u8:019:32:051
24237991512,2cyclictest26762-21kworker/u8:219:23:051
24237991512,2cyclictest21977-21kworker/u8:000:23:041
24237991512,2cyclictest19876-21kworker/u8:021:08:041
24237991512,2cyclictest10140-21kworker/u8:220:27:041
24237991512,2cyclictest0-21swapper/123:05:091
24237991511,2cyclictest13849-21kworker/u8:100:33:041
24237991510,3cyclictest30703-21hddtemp_smartct22:25:141
2423799150,10cyclictest0-21swapper/119:52:041
2423699151,3cyclictest28881-21ssh00:37:530
2423999142,7cyclictest27499-21ssh23:30:003
2423999141,3cyclictest31309-21ssh22:25:303
2423999141,2cyclictest7340-21ssh23:41:223
24239991411,2cyclictest0-21swapper/323:00:193
24239991411,2cyclictest0-21swapper/322:20:093
2423999140,3cyclictest16549-21ssh23:17:553
2423999140,2cyclictest0-21swapper/300:11:003
2423999140,13cyclictest0-21swapper/319:50:083
2423999140,12cyclictest0-21swapper/322:55:143
2423999140,12cyclictest0-21swapper/322:35:153
2423999140,12cyclictest0-21swapper/322:32:553
2423999140,12cyclictest0-21swapper/322:10:153
2423899149,3cyclictest0-21swapper/221:28:232
2423899142,7cyclictest0-21swapper/219:20:012
24238991411,2cyclictest31039-21ntpdc22:25:162
24238991411,2cyclictest24235-21cyclictest20:30:082
24238991411,2cyclictest0-21swapper/223:58:592
24238991411,2cyclictest0-21swapper/222:36:302
24238991411,2cyclictest0-21swapper/221:11:002
2423899140,2cyclictest0-21swapper/200:00:502
2423899140,13cyclictest0-21swapper/223:24:492
2423899140,13cyclictest0-21swapper/220:00:582
2423899140,12cyclictest0-21swapper/222:20:012
2423899140,12cyclictest0-21swapper/200:10:592
24237991411,2cyclictest7954-21kworker/u8:120:32:051
24237991411,2cyclictest3794-21kworker/u8:123:15:051
24237991411,2cyclictest31620-21kworker/u8:021:59:041
24237991411,2cyclictest19876-21kworker/u8:021:02:041
24237991410,2cyclictest0-21swapper/100:11:041
2423799140,13cyclictest0-21swapper/123:45:591
2423799140,12cyclictest0-21swapper/122:35:181
2423799140,12cyclictest0-21swapper/122:20:081
2423799140,12cyclictest0-21swapper/121:25:111
2423799140,10cyclictest0-21swapper/120:16:041
2423699142,7cyclictest0-21swapper/019:44:590
2423699140,12cyclictest6612-21hddtemp_smartct22:00:160
2423999132,6cyclictest0-21swapper/319:45:003
24239991311,1cyclictest0-21swapper/300:00:103
24239991310,2cyclictest3298-21apt-get23:05:053
24239991310,2cyclictest30926-21ssh21:51:353
24239991310,2cyclictest0-21swapper/323:21:063
24239991310,2cyclictest0-21swapper/322:45:393
24239991310,2cyclictest0-21swapper/321:45:383
24239991310,2cyclictest0-21swapper/321:39:413
24239991310,2cyclictest0-21swapper/321:34:433
24239991310,2cyclictest0-21swapper/321:27:113
24239991310,2cyclictest0-21swapper/321:20:143
24239991310,2cyclictest0-21swapper/320:10:563
24239991310,2cyclictest0-21swapper/300:09:023
2423999130,3cyclictest29943-21ssh00:39:353
2423999130,2cyclictest19923-21ssh00:28:563
2423999130,2cyclictest0-21swapper/323:45:433
2423999130,2cyclictest0-21swapper/323:31:353
2423999130,2cyclictest0-21swapper/322:15:523
2423999130,2cyclictest0-21swapper/322:06:063
2423999130,2cyclictest0-21swapper/321:10:103
2423999130,2cyclictest0-21swapper/320:30:083
2423999130,2cyclictest0-21swapper/300:30:573
2423999130,12cyclictest0-21swapper/323:35:063
2423999130,12cyclictest0-21swapper/321:18:073
2423999130,12cyclictest0-21swapper/300:15:143
2423899138,3cyclictest0-21swapper/221:44:252
24238991310,2cyclictest0-21swapper/223:16:482
24238991310,2cyclictest0-21swapper/222:48:372
24238991310,2cyclictest0-21swapper/222:06:232
24238991310,2cyclictest0-21swapper/221:31:272
24238991310,2cyclictest0-21swapper/200:15:402
2423899130,2cyclictest0-21swapper/223:50:322
2423899130,2cyclictest0-21swapper/222:30:392
2423899130,12cyclictest0-21swapper/222:58:042
2423899130,12cyclictest0-21swapper/221:58:002
2423899130,12cyclictest0-21swapper/221:16:392
2423899130,12cyclictest0-21swapper/200:06:192
2423899130,11cyclictest23401-21diskmemload21:35:452
2423899130,11cyclictest0-21swapper/221:23:042
2423799138,3cyclictest0-21swapper/121:30:171
2423799131,10cyclictest20622-21ssh23:55:171
24237991310,2cyclictest7954-21kworker/u8:120:53:041
24237991310,2cyclictest7954-21kworker/u8:120:42:041
24237991310,2cyclictest29546-21kworker/u8:223:40:061
24237991310,2cyclictest28831-21kworker/u8:019:48:051
24237991310,2cyclictest21703-21ssh22:15:381
24237991310,2cyclictest12805-21kworker/u8:020:35:041
24237991310,2cyclictest11789-21kworker/u8:221:35:051
24237991310,2cyclictest0-21swapper/123:50:091
24237991310,2cyclictest0-21swapper/100:06:401
2423799130,12cyclictest0-21swapper/121:41:091
2423799130,12cyclictest0-21swapper/121:20:101
2423799130,11cyclictest0-21swapper/100:25:181
2423699132,6cyclictest0-21swapper/020:29:590
144112130,2sleep00-21swapper/022:41:460
128132130,2sleep30-21swapper/322:40:163
86312120,2sleep00-21swapper/022:35:540
2423999120,11cyclictest0-21swapper/323:11:083
2423999120,11cyclictest0-21swapper/321:00:113
2423999120,11cyclictest0-21swapper/320:50:153
2423999120,11cyclictest0-21swapper/320:20:353
2423899129,2cyclictest3298-21apt-get23:05:042
2423899129,2cyclictest0-21swapper/223:26:052
2423899129,2cyclictest0-21swapper/220:39:352
2423899129,2cyclictest0-21swapper/220:20:142
2423899122,7cyclictest0-21swapper/220:19:582
2423899122,6cyclictest0-21swapper/220:00:002
2423899122,5cyclictest0-21swapper/219:30:002
2423899121,6cyclictest18218-21copy20:50:012
2423899120,2cyclictest0-21swapper/223:41:142
2423899120,2cyclictest0-21swapper/223:11:552
2423899120,2cyclictest0-21swapper/220:50:122
2423899120,11cyclictest0-21swapper/223:02:012
2423899120,11cyclictest0-21swapper/222:11:582
2423899120,11cyclictest0-21swapper/200:35:192
2423799129,2cyclictest7954-21kworker/u8:120:46:051
2423799129,2cyclictest5426-21kworker/u8:022:40:011
2423799129,2cyclictest0-21swapper/123:31:581
2423799129,2cyclictest0-21swapper/122:52:041
2423799122,7cyclictest0-21swapper/119:44:591
2423799121,9cyclictest22701-21munin-run23:24:591
2423799121,9cyclictest0-21swapper/120:20:151
2423799121,9cyclictest0-21swapper/120:10:131
2423799121,3cyclictest16832-21aten2.4-expect22:45:101
24237991210,1cyclictest0-21swapper/119:10:111
2423799120,2cyclictest0-21swapper/123:25:091
2423799120,2cyclictest0-21swapper/120:05:051
2423799120,2cyclictest0-21swapper/100:36:041
2423699128,3cyclictest1555-21sh23:02:210
2423699127,4cyclictest14040-21ssh22:08:020
2423699127,3cyclictest30112-21sed00:05:170
2423699122,6cyclictest0-21swapper/023:34:590
2423699122,6cyclictest0-21swapper/019:50:000
2423699121,6cyclictest0-21swapper/020:55:000
2423699120,2cyclictest0-21swapper/021:40:590
2423699120,11cyclictest0-21swapper/000:30:140
2423699120,10cyclictest0-21swapper/021:12:170
223252120,2sleep00-21swapper/023:57:180
183762120,2sleep00-21swapper/021:39:380
306772110,2sleep00-21swapper/021:18:320
2423999112,6cyclictest0-21swapper/319:21:583
2423999112,5cyclictest0-21swapper/319:49:593
2423999110,10cyclictest0-21swapper/319:59:563
2423899118,2cyclictest0-21swapper/219:40:592
2423899112,7cyclictest0-21swapper/219:39:582
2423899112,6cyclictest0-21swapper/221:06:022
2423899112,6cyclictest0-21swapper/219:22:582
2423899111,5cyclictest0-21swapper/220:10:002
2423799111,6cyclictest0-21swapper/119:15:521
2423699116,3cyclictest4661-21sed23:05:150
2423699112,6cyclictest0-21swapper/020:35:000
2423699112,6cyclictest0-21swapper/020:13:590
2423699112,6cyclictest0-21swapper/020:00:000
2423699111,5cyclictest0-21swapper/023:50:000
2423699111,5cyclictest0-21swapper/022:25:010
2423699111,5cyclictest0-21swapper/019:10:000
2423699110,3cyclictest0-21swapper/022:11:020
2423699110,1cyclictest0-21swapper/022:30:140
2423699110,10cyclictest21977-21kworker/u8:000:16:020
233572110,2sleep00-21swapper/021:09:350
2423999107,2cyclictest0-21swapper/320:40:123
2423899107,2cyclictest0-21swapper/219:54:352
2423899105,3cyclictest29678-21munin-node2
2423899100,6cyclictest0-21swapper/219:11:002
2423799100,2cyclictest0-21swapper/119:55:051
2423699105,3cyclictest10898-21mailstats21:30:590
2423699103,6cyclictest0-21swapper/021:56:000
2423699102,6cyclictest0-21swapper/020:20:580
2423699101,6cyclictest0-21swapper/023:43:590
2423699101,5cyclictest32675-21kworker/0:220:04:590
2423699101,2cyclictest24235-21cyclictest00:22:560
2423699100,9cyclictest6143-21kworker/u8:222:15:040
2423699100,9cyclictest0-21swapper/020:40:090
2423699100,8cyclictest0-21swapper/022:55:010
2423699100,8cyclictest0-21swapper/019:35:010
2423699100,4cyclictest0-21swapper/023:28:060
195722100,7sleep00-21swapper/023:20:460
28578290,2sleep00-21swapper/019:21:220
242399994,3cyclictest10244-21cron20:20:003
242399992,3cyclictest12510-21taskset20:25:233
242389994,3cyclictest20739-21cron21:00:002
242379990,2cyclictest0-21swapper/119:36:011
242369996,2cyclictest0-21swapper/023:16:270
242369996,2cyclictest0-21swapper/021:25:110
242369994,3cyclictest6101-21needreboot20:00:120
242369994,3cyclictest400-21cpuspeed_turbos23:35:130
242369994,3cyclictest3156-21iostat_ios19:50:110
242369994,3cyclictest27752-21ssh22:55:400
242369994,3cyclictest26364-21uptime00:01:020
242369994,3cyclictest24069-21grep21:45:120
242369994,3cyclictest1817-21tr00:10:120
242369994,3cyclictest15155-21df_abs23:50:130
242369994,3cyclictest0-21swapper/000:26:020
242369993,5cyclictest0-21swapper/019:25:040
242369991,6cyclictest0-21swapper/021:00:580
242369991,6cyclictest0-21swapper/020:36:090
242369991,5cyclictest18218-21copy20:50:000
242369990,6cyclictest0-21swapper/023:11:000
242399983,3cyclictest7326-21taskset20:06:013
242399983,3cyclictest6646-21grep20:00:583
242399983,3cyclictest31998-21taskset19:39:093
242399983,3cyclictest291072sleep319:25:283
242399983,3cyclictest26741-21taskset19:18:503
242399983,3cyclictest20984-21packagekitd21:05:103
242399983,3cyclictest20482-21chrt20:56:443
242399983,3cyclictest154122sleep320:39:123
242399983,3cyclictest12119-21kworker/3:020:46:583
242389983,3cyclictest8047-21cpu20:10:082
242389983,3cyclictest15990-21tr20:40:082
242389983,3cyclictest127682sleep220:28:412
242389980,2cyclictest0-21swapper/219:45:082
242369984,3cyclictest9-21ksoftirqd/020:16:360
242369983,3cyclictest0-21swapper/020:45:570
242369980,5cyclictest0-21swapper/019:38:430
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional