You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 21:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Mar 17, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
288779910218,57cyclictest6387-21telnet06:01:340
2887799994,13cyclictest0-21swapper/008:11:100
2888199983,87cyclictest10604-21gltestperf09:46:343
2887799964,13cyclictest0-21swapper/007:53:470
2887799954,66cyclictest0-21swapper/010:51:310
2887799953,72cyclictest0-21swapper/009:41:360
2887799953,67cyclictest0-21swapper/009:16:410
2887799943,72cyclictest20769-21ssh08:26:320
2887799934,13cyclictest0-21swapper/009:21:390
2887799934,13cyclictest0-21swapper/009:21:390
2887799934,12cyclictest0-21swapper/008:46:310
28877999320,54cyclictest0-21swapper/010:01:270
28877999320,54cyclictest0-21swapper/010:01:270
28877999319,50cyclictest17803-21munin-node10:46:370
2887799925,74cyclictest0-21swapper/008:12:430
2887799924,14cyclictest0-21swapper/011:01:440
2887799923,71cyclictest0-21swapper/007:45:040
2887799904,68cyclictest0-21swapper/008:31:410
2887799904,68cyclictest0-21swapper/008:04:490
2887799904,64cyclictest0-21swapper/010:09:470
28877999027,47cyclictest31410-21gltestperf08:41:340
28877999027,47cyclictest31410-21gltestperf08:41:340
2887799894,66cyclictest0-21swapper/008:36:370
2887799894,62cyclictest0-21swapper/009:36:500
2887799894,62cyclictest0-21swapper/008:56:310
2887799894,61cyclictest0-21swapper/009:11:340
2887799894,61cyclictest0-21swapper/007:16:480
2887799894,61cyclictest0-21swapper/007:16:480
28877998912,62cyclictest0-21swapper/011:06:430
2887799884,70cyclictest0-21swapper/010:33:270
2887799884,63cyclictest0-21swapper/010:20:130
2887799884,63cyclictest0-21swapper/009:09:570
2887799884,12cyclictest0-21swapper/009:46:420
2887799884,12cyclictest0-21swapper/009:03:060
28877998816,54cyclictest0-21swapper/010:44:060
28877998816,54cyclictest0-21swapper/010:44:060
2887799876,12cyclictest0-21swapper/010:24:430
2887799874,75cyclictest0-21swapper/009:31:390
2887799874,67cyclictest0-21swapper/007:48:390
2887799874,66cyclictest0-21swapper/008:51:330
2887799874,13cyclictest0-21swapper/010:36:160
2887799874,12cyclictest0-21swapper/005:41:430
2887799873,21cyclictest0-21swapper/009:52:490
28877998714,10cyclictest0-21swapper/011:00:470
2887799864,68cyclictest0-21swapper/009:27:470
2887799864,67cyclictest0-21swapper/006:59:500
2887799864,64cyclictest0-21swapper/007:21:450
2887799864,13cyclictest0-21swapper/010:27:540
2887799864,13cyclictest0-21swapper/007:59:220
2887799863,65cyclictest0-21swapper/010:12:220
248599860,7rtkit-daemon0-21swapper/007:41:190
2888199853,74cyclictest1419-21runrttasks08:05:253
2887799854,64cyclictest0-21swapper/008:22:320
2887799854,12cyclictest0-21swapper/006:14:490
28877998514,7cyclictest18453-21ssh09:57:190
2888199844,61cyclictest0-21swapper/309:26:293
2887799844,66cyclictest0-21swapper/007:15:530
2887799844,65cyclictest0-21swapper/006:36:380
2887799844,65cyclictest0-21swapper/006:36:380
2887799843,64cyclictest0-21swapper/008:16:370
28877998315,46cyclictest0-21swapper/006:41:340
248599830,9rtkit-daemon0-21swapper/108:47:173
2888199825,61cyclictest0-21swapper/310:30:573
2888199825,57cyclictest0-21swapper/308:23:053
2888199824,71cyclictest12708-21timerandwakeup10:36:453
2888199824,70cyclictest0-21swapper/308:31:333
2887799824,56cyclictest0-21swapper/005:56:440
2887799824,13cyclictest0-21swapper/006:31:460
2887799824,13cyclictest0-21swapper/006:21:560
2887799823,73cyclictest0-21swapper/007:31:420
2888199815,55cyclictest0-21swapper/309:00:283
2888199814,70cyclictest0-21swapper/308:18:143
2888199813,71cyclictest0-21swapper/308:51:523
2888199813,71cyclictest0-21swapper/308:13:023
2888199813,70cyclictest1912-21ssh10:21:363
2887799814,57cyclictest0-21swapper/007:06:340
2887799814,14cyclictest0-21swapper/005:51:230
2888199804,69cyclictest0-21swapper/311:11:103
2888199804,69cyclictest0-21swapper/310:00:353
2888199804,68cyclictest0-21swapper/309:35:233
2888199803,70cyclictest26021-21wc10:56:423
2887799804,14cyclictest0-21swapper/006:31:220
2887799803,69cyclictest27926-21taskset06:46:340
2888199794,66cyclictest0-21swapper/310:19:533
2888199793,61cyclictest24508-21ssh07:44:433
2888199793,59cyclictest4987-21munin-node05:56:463
2888199793,58cyclictest23532-21cpuspeed_turbos10:06:263
2887799794,59cyclictest0-21swapper/006:55:040
28877997914,43cyclictest0-21swapper/007:26:320
110502790,7sleep10-21swapper/107:16:451
110502790,7sleep10-21swapper/107:16:451
2888199785,66cyclictest0-21swapper/310:51:253
2888199784,57cyclictest0-21swapper/311:04:363
2888199783,68cyclictest0-21swapper/310:42:413
2888199783,68cyclictest0-21swapper/310:42:413
2888199783,68cyclictest0-21swapper/306:26:523
2888199783,67cyclictest6217-21latency_hist09:41:153
2888199783,67cyclictest25484-21cpuspeed_turbos09:21:283
2888199783,67cyclictest25484-21cpuspeed_turbos09:21:283
2888199783,67cyclictest14440-21munin-node09:51:423
2888199783,55cyclictest4697-21kworker/3:009:04:533
2887799784,13cyclictest0-21swapper/006:06:330
2888199775,65cyclictest0-21swapper/309:15:473
2888199774,54cyclictest0-21swapper/310:14:443
2888199773,67cyclictest21294-21gltestperf08:26:373
2888199773,67cyclictest0-21swapper/307:56:193
2888199773,66cyclictest15672-21idleruntime-cro06:21:213
2888199773,66cyclictest0-21swapper/307:35:033
2888199773,57cyclictest23483-21timerwakeupswit09:16:473
2887799773,59cyclictest0-21swapper/006:16:420
2888199764,65cyclictest0-21swapper/308:45:563
2888199764,65cyclictest0-21swapper/308:45:563
2888199764,52cyclictest0-21swapper/308:08:183
2888199763,66cyclictest9659-21seq10:32:043
2888199763,45cyclictest0-21swapper/307:46:523
2887799764,14cyclictest0-21swapper/005:41:230
2887799764,12cyclictest0-21swapper/005:53:580
2887799764,12cyclictest0-21swapper/005:53:580
2888199755,63cyclictest0-21swapper/306:24:513
2888199754,66cyclictest0-21swapper/309:41:293
2888199754,64cyclictest0-21swapper/310:50:163
2888199754,64cyclictest0-21swapper/306:11:443
2888199754,55cyclictest0-21swapper/307:51:363
2888199753,65cyclictest0-21swapper/308:36:503
2888199753,55cyclictest6390-21seq06:01:343
28881997523,40cyclictest29952-21gltestperf05:41:443
2887799753,10cyclictest2738-21munin-node07:01:540
248599750,7rtkit-daemon0-21swapper/106:36:523
248599750,7rtkit-daemon0-21swapper/106:36:523
2888199744,63cyclictest0-21swapper/307:31:193
2888199744,63cyclictest0-21swapper/305:46:423
2888199743,64cyclictest15430-21cpuspeed_turbos09:06:283
2888199743,64cyclictest0-21swapper/306:41:453
248599740,6rtkit-daemon0-21swapper/205:41:242
2888199734,63cyclictest0-21swapper/307:21:333
2888199724,53cyclictest0-21swapper/307:36:483
2888199723,62cyclictest10465-21df_inode07:16:363
2888199723,62cyclictest10465-21df_inode07:16:363
28880997251,13cyclictest0-21swapper/208:02:152
2888199713,62cyclictest9347-21taskset07:12:193
2888199713,61cyclictest8771-21sh06:06:333
2888199713,54cyclictest20827-21munin-node10:01:333
2888199713,54cyclictest20827-21munin-node10:01:333
2888199703,49cyclictest7298-21latency_hist07:11:203
2888199694,58cyclictest0-21swapper/306:31:573
2888199693,59cyclictest30093-21latency_hist06:51:213
2888099684,55cyclictest0-21swapper/208:26:392
2888199673,41cyclictest30249-21munin-node06:51:413
2887999674,54cyclictest0-21swapper/109:53:001
2888199662,51cyclictest0-21swapper/307:01:323
2888099664,53cyclictest0-21swapper/210:16:412
2888099664,52cyclictest0-21swapper/209:51:292
2887999664,54cyclictest0-21swapper/110:41:391
2887999664,54cyclictest0-21swapper/110:41:391
28879996626,24cyclictest0-21swapper/108:39:071
2888199653,56cyclictest2703-21load05:51:473
2888199653,56cyclictest2703-21load05:51:473
2888199653,54cyclictest1419-21runrttasks06:59:013
2887999655,50cyclictest9330-21timerandwakeup10:31:441
2887999653,54cyclictest0-21swapper/110:16:141
28879996520,27cyclictest21704-21needreboot08:26:431
266192650,6sleep20-21swapper/210:57:302
2888099645,51cyclictest0-21swapper/207:48:422
2888099644,52cyclictest0-21swapper/208:13:102
2888099643,55cyclictest0-21swapper/208:06:492
2887999644,50cyclictest11824-21ssh09:01:271
2888099634,52cyclictest0-21swapper/208:19:272
2888099634,51cyclictest0-21swapper/207:45:042
2888099632,54cyclictest0-21swapper/205:41:402
248599630,5rtkit-daemon2484-21rtkit-daemon06:55:442
2888099623,50cyclictest0-21swapper/208:46:492
2887999624,50cyclictest2513-21udisks-daemon08:21:401
2888099614,50cyclictest0-21swapper/210:51:282
2887999614,49cyclictest7494-21latency_hist10:31:121
2887999614,49cyclictest0-21swapper/108:18:351
28879996118,34cyclictest0-21swapper/107:46:471
2888099604,48cyclictest0-21swapper/210:21:262
2888099603,51cyclictest0-21swapper/208:57:092
2888099603,51cyclictest0-21swapper/208:00:172
2888099603,50cyclictest0-21swapper/209:11:392
2888099602,52cyclictest0-21swapper/209:17:212
2887999606,16cyclictest0-21swapper/109:56:321
2888099594,37cyclictest0-21swapper/210:47:432
2888099593,50cyclictest0-21swapper/210:06:302
2888099592,50cyclictest0-21swapper/209:31:152
2888099585,45cyclictest0-21swapper/207:30:522
2888099584,47cyclictest0-21swapper/209:06:422
2888099583,49cyclictest0-21swapper/210:39:242
2887999585,45cyclictest0-21swapper/110:56:411
28879995819,31cyclictest21343-21cpu10:51:221
2888199574,47cyclictest0-21swapper/305:41:233
2888099575,9cyclictest0-21swapper/211:01:272
2888099574,47cyclictest0-21swapper/207:51:522
2888099574,45cyclictest0-21swapper/206:11:512
2888099574,42cyclictest5215-21munin-node08:51:272
2888099574,38cyclictest0-21swapper/210:00:482
2888099573,49cyclictest0-21swapper/210:12:312
2888099573,48cyclictest0-21swapper/210:43:262
2888099573,48cyclictest0-21swapper/210:43:262
2888099573,47cyclictest0-21swapper/210:01:262
2888099573,47cyclictest0-21swapper/210:01:262
2887999576,17cyclictest0-21swapper/109:08:371
2887999575,30cyclictest0-21swapper/109:36:301
2887999575,16cyclictest0-21swapper/111:06:071
2887999574,33cyclictest0-21swapper/109:16:471
2888099565,34cyclictest0-21swapper/209:31:382
2888099564,44cyclictest0-21swapper/207:36:192
2888099564,13cyclictest0-21swapper/209:36:392
28880995637,11cyclictest24790-21unixbench_multi06:36:542
28880995637,11cyclictest24790-21unixbench_multi06:36:542
2888099563,9cyclictest0-21swapper/209:41:402
2888099563,47cyclictest0-21swapper/211:06:262
2888099563,46cyclictest0-21swapper/209:21:392
2888099563,46cyclictest0-21swapper/209:21:392
2887999564,45cyclictest0-21swapper/107:56:481
2887999564,32cyclictest0-21swapper/109:12:301
2887999564,32cyclictest0-21swapper/107:52:191
2887999564,28cyclictest795-21munin-node10:21:281
2887999563,46cyclictest0-21swapper/108:52:521
93842553,46sleep10-21swapper/108:08:461
2888099554,44cyclictest0-21swapper/208:21:292
2888099554,28cyclictest0-21swapper/209:01:322
28880995536,12cyclictest7833-21basename10:31:242
28880995535,13cyclictest0-21swapper/208:36:312
28880995535,12cyclictest8298-21tune2fs07:11:382
2888099553,46cyclictest0-21swapper/208:31:232
2887999555,31cyclictest0-21swapper/108:31:391
2887999555,28cyclictest0-21swapper/110:16:371
2887999554,45cyclictest0-21swapper/110:03:351
2887999554,45cyclictest0-21swapper/110:03:351
2887999554,12cyclictest0-21swapper/107:16:191
2887999553,39cyclictest0-21swapper/106:21:501
28879995522,11cyclictest4974-21ssh08:01:471
190552553,45sleep10-21swapper/107:34:071
2888099545,14cyclictest31452-21grep08:41:342
2888099545,14cyclictest31452-21grep08:41:342
2888099543,44cyclictest116142chrt09:46:552
2888099543,43cyclictest4346-21munin-node10:26:292
28880995411,36cyclictest20445-21crond06:31:212
2887999546,29cyclictest0-21swapper/110:11:131
2887999544,33cyclictest0-21swapper/108:41:351
2887999544,33cyclictest0-21swapper/108:41:351
2887999543,45cyclictest19228-21processes10:46:391
2887999543,45cyclictest0-21swapper/106:16:431
28879995419,27cyclictest0-21swapper/107:41:361
135772543,42sleep10-21swapper/107:21:461
119922543,8sleep111080-21munin-node10:36:331
2888099534,41cyclictest18071-21sleep06:26:212
2888099532,45cyclictest0-21swapper/207:01:342
2887999536,28cyclictest0-21swapper/109:26:481
2887999536,28cyclictest0-21swapper/107:06:331
2887999535,14cyclictest0-21swapper/109:01:151
2887999534,29cyclictest0-21swapper/109:46:311
28879995332,13cyclictest31378-21aten_r1power_po11:06:221
2887999533,9cyclictest0-21swapper/109:25:291
2887999533,9cyclictest0-21swapper/109:25:291
28879995322,13cyclictest0-21swapper/109:31:241
28879995316,10cyclictest20444-21crond06:31:211
28879995314,32cyclictest201ktimersoftd/108:11:351
93222524,41sleep10-21swapper/106:06:401
2888099525,39cyclictest0-21swapper/207:06:312
2888099525,39cyclictest0-21swapper/206:56:432
2888099523,43cyclictest0-21swapper/206:01:242
2888099523,42cyclictest15554-21taskset06:19:562
28880995223,23cyclictest0-21swapper/206:01:392
2887999525,28cyclictest0-21swapper/106:51:441
2887999523,43cyclictest0-21swapper/109:41:311
2887999523,42cyclictest0-21swapper/105:51:501
2887999523,42cyclictest0-21swapper/105:51:501
28879995223,11cyclictest3042-21cpuspeed_turbos07:01:341
28879995220,14cyclictest0-21swapper/105:46:501
28879995217,26cyclictest24825-21unixbench_singl06:36:541
28879995217,26cyclictest24825-21unixbench_singl06:36:541
24482524,11sleep10-21swapper/107:01:101
311342513,10sleep10-21swapper/105:44:591
2888099515,28cyclictest0-21swapper/206:31:402
2888099514,28cyclictest0-21swapper/207:25:382
2887999514,39cyclictest0-21swapper/106:46:531
2887999514,28cyclictest0-21swapper/106:01:471
2887999514,13cyclictest0-21swapper/108:49:131
28879995121,12cyclictest0-21swapper/106:34:521
215252513,41sleep10-21swapper/107:40:161
35792502,41sleep20-21swapper/205:54:242
35792502,41sleep20-21swapper/205:54:242
2887999505,27cyclictest0-21swapper/105:59:471
2887999504,28cyclictest0-21swapper/106:11:441
265992503,40sleep10-21swapper/106:41:471
2888099493,41cyclictest0-21swapper/207:16:322
2888099493,41cyclictest0-21swapper/207:16:322
2887999494,28cyclictest0-21swapper/107:26:321
2888099484,37cyclictest0-21swapper/206:06:502
2888099484,27cyclictest0-21swapper/207:36:362
28880994833,9cyclictest28675-21grep06:46:412
2888099473,38cyclictest0-21swapper/206:41:332
2888099464,35cyclictest0-21swapper/205:51:232
2887999387,19cyclictest0-21swapper/105:41:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional