You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 01:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Mar 10, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291502980,6sleep31583199cyclictest18:13:483
1582799974,85cyclictest0-21swapper/019:03:440
15827999620,57cyclictest4498-21cstates20:28:340
1582799958,80cyclictest0-21swapper/019:59:120
1583199944,24cyclictest0-21swapper/320:40:513
15831999436,50cyclictest0-21swapper/321:19:423
1582799944,83cyclictest0-21swapper/021:32:150
15831999337,49cyclictest21348-21unixbench_singl19:04:023
1582799934,81cyclictest0-21swapper/021:33:290
1582799934,81cyclictest0-21swapper/021:33:290
1582799934,54cyclictest0-21swapper/019:53:220
248599920,18rtkit-daemon0-21swapper/020:59:283
1582799924,80cyclictest0-21swapper/020:33:380
1582799924,69cyclictest0-21swapper/020:24:430
1582799924,55cyclictest0-21swapper/023:03:420
1582799924,50cyclictest0-21swapper/021:23:390
1583199915,22cyclictest0-21swapper/321:08:523
1583199914,39cyclictest29854-21ssh21:53:353
1583199913,9cyclictest121850irq/46-eth022:03:073
1582799915,68cyclictest0-21swapper/023:08:430
1582799914,80cyclictest0-21swapper/022:14:070
1582799914,80cyclictest0-21swapper/022:14:070
1582799914,80cyclictest0-21swapper/020:58:400
1582799905,78cyclictest0-21swapper/020:53:410
1582799905,78cyclictest0-21swapper/020:53:410
1582799904,79cyclictest0-21swapper/021:48:330
1582799904,54cyclictest0-21swapper/020:08:320
1582799904,45cyclictest0-21swapper/022:23:440
248599890,17rtkit-daemon0-21swapper/022:06:333
248599890,17rtkit-daemon0-21swapper/021:35:343
248599890,17rtkit-daemon0-21swapper/021:35:343
1583199894,23cyclictest0-21swapper/320:12:263
1583199894,12cyclictest0-21swapper/320:19:183
15831998930,10cyclictest24025-21gltestperf18:03:443
15831998928,9cyclictest17907-21cut20:48:333
1582799894,77cyclictest0-21swapper/021:13:310
1582799894,64cyclictest0-21swapper/021:38:360
1582799893,80cyclictest0-21swapper/022:53:290
1582799893,80cyclictest0-21swapper/022:53:290
1582799893,79cyclictest0-21swapper/022:43:410
1582799893,78cyclictest0-21swapper/018:58:390
15827998913,53cyclictest28532-21ssh22:38:460
1583199884,26cyclictest0-21swapper/323:15:483
1583199884,24cyclictest0-21swapper/321:50:343
15831998811,14cyclictest0-21swapper/321:03:443
1582799884,77cyclictest0-21swapper/022:33:330
1582799884,77cyclictest0-21swapper/021:44:270
1582799884,77cyclictest0-21swapper/021:08:370
1582799884,77cyclictest0-21swapper/020:03:530
1582799884,76cyclictest0-21swapper/022:48:300
1582799884,76cyclictest0-21swapper/022:18:270
1582799884,76cyclictest0-21swapper/022:18:270
1582799884,76cyclictest0-21swapper/020:18:450
1582799884,76cyclictest0-21swapper/020:13:350
1582799884,76cyclictest0-21swapper/020:13:350
1582799883,9cyclictest18478-21gltestperf20:48:390
76972870,13sleep2281ktimersoftd/221:20:082
1583199873,32cyclictest368-21aten_r1power_fr18:23:373
1583199873,24cyclictest1287-21snmpd22:35:413
15831998726,12cyclictest0-21swapper/320:08:153
1582799874,77cyclictest0-21swapper/022:03:330
1582799874,76cyclictest0-21swapper/020:43:420
1582799874,75cyclictest0-21swapper/023:15:350
1582799874,69cyclictest0-21swapper/021:03:400
1582799874,66cyclictest0-21swapper/020:38:310
1582799874,53cyclictest0-21swapper/023:01:290
1582799874,53cyclictest0-21swapper/023:01:290
1583199865,39cyclictest0-21swapper/322:44:143
1583199865,19cyclictest14773-21yum-updatesd-he21:31:443
1583199864,24cyclictest0-21swapper/318:48:363
1583199864,24cyclictest0-21swapper/318:48:363
15831998626,10cyclictest1350-21aten_r1power_po22:48:273
15831998614,12cyclictest8404-21cpuspeed_turbos22:58:273
15831998614,12cyclictest8404-21cpuspeed_turbos22:58:273
1582799864,76cyclictest0-21swapper/022:00:260
1582799864,75cyclictest0-21swapper/021:18:490
1582799864,75cyclictest0-21swapper/018:36:280
1582799863,65cyclictest0-21swapper/022:11:590
1582799863,59cyclictest27099-21cpuspeed_turbos19:18:360
1583199854,36cyclictest0-21swapper/322:28:283
1583199854,27cyclictest0-21swapper/320:13:353
1583199854,27cyclictest0-21swapper/320:13:353
1583199854,25cyclictest0-21swapper/318:00:383
15831998522,22cyclictest0-21swapper/321:24:463
1583199845,33cyclictest0-21swapper/318:18:523
1583199844,27cyclictest0-21swapper/320:35:223
1583199844,27cyclictest0-21swapper/320:28:373
1583199844,27cyclictest0-21swapper/319:13:433
1583199844,26cyclictest0-21swapper/322:22:153
1583199844,26cyclictest0-21swapper/322:22:153
1583199844,26cyclictest0-21swapper/319:55:183
1583199844,24cyclictest0-21swapper/319:10:073
1583199844,12cyclictest0-21swapper/322:08:343
1583199843,23cyclictest18893-21taskset22:24:273
1582799844,73cyclictest0-21swapper/019:28:230
1582799844,51cyclictest0-21swapper/022:29:080
1582799844,12cyclictest0-21swapper/018:03:370
1582799843,9cyclictest0-21swapper/018:15:380
1582799843,10cyclictest0-21swapper/021:55:230
1583199834,33cyclictest0-21swapper/323:05:453
1583199834,24cyclictest0-21swapper/322:56:523
1583199834,24cyclictest0-21swapper/322:56:523
1583199834,23cyclictest0-21swapper/322:18:023
1583199834,23cyclictest0-21swapper/322:18:023
1583199834,23cyclictest0-21swapper/320:24:303
1583199834,13cyclictest0-21swapper/321:40:183
1583199833,34cyclictest0-21swapper/320:03:183
15831998326,11cyclictest23465-21grep21:43:423
1582799835,65cyclictest0-21swapper/019:53:510
1582799834,60cyclictest0-21swapper/018:43:400
1582799833,73cyclictest0-21swapper/019:28:580
1583199823,25cyclictest0-21swapper/320:44:483
190292810,7sleep119030-21awk17:53:431
1583199814,26cyclictest0-21swapper/322:38:313
1583199814,14cyclictest0-21swapper/318:09:573
1583199814,14cyclictest0-21swapper/318:09:573
1582799814,51cyclictest0-21swapper/018:48:350
1582799814,51cyclictest0-21swapper/018:48:350
1582799813,8cyclictest8560-21sadc19:48:220
15831998028,8cyclictest3714-21timerandwakeup21:13:513
1582799804,69cyclictest0-21swapper/017:48:460
1582799804,68cyclictest0-21swapper/017:53:580
1582799804,65cyclictest0-21swapper/018:53:410
1582799804,52cyclictest0-21swapper/019:13:450
1582799803,9cyclictest0-21swapper/019:38:320
1582799803,9cyclictest0-21swapper/018:28:460
1583199794,26cyclictest0-21swapper/317:55:383
1583199794,12cyclictest0-21swapper/319:31:503
1583199793,26cyclictest0-21swapper/319:18:403
15831997928,11cyclictest9627-21gltestperf19:48:423
1582799794,60cyclictest7679-21tail18:38:350
1582799793,9cyclictest0-21swapper/019:10:070
15831997820,13cyclictest0-21swapper/320:56:073
15831997820,13cyclictest0-21swapper/320:56:073
1582799784,68cyclictest0-21swapper/018:28:090
1582799783,7cyclictest1419-21runrttasks18:00:080
1583199773,24cyclictest0-21swapper/319:45:133
15831997728,12cyclictest0-21swapper/318:38:353
1582799774,67cyclictest0-21swapper/018:18:450
1582799773,56cyclictest18303-1kworker/0:0H19:38:220
1582799773,56cyclictest18303-1kworker/0:0H19:38:220
1583199764,26cyclictest0-21swapper/319:40:133
248599750,18rtkit-daemon29196-21netstat18:13:491
1582799755,60cyclictest15815-21munin-run17:48:260
1583199744,23cyclictest0-21swapper/323:10:053
15831997426,11cyclictest0-21swapper/317:48:413
1582799743,10cyclictest0-21swapper/018:09:570
1582799743,10cyclictest0-21swapper/018:09:570
1532027411,50sleep10-21swapper/117:43:541
1583199736,33cyclictest0-21swapper/319:33:333
1583199736,33cyclictest0-21swapper/319:33:333
15829997318,48cyclictest25879-21switchtime20:58:501
248599720,7rtkit-daemon0-21swapper/220:35:362
248599690,17rtkit-daemon2484-21rtkit-daemon23:04:162
248599680,9rtkit-daemon0-21swapper/221:14:572
248599680,8rtkit-daemon0-21swapper/221:39:112
248599670,7rtkit-daemon0-21swapper/222:17:172
248599670,7rtkit-daemon0-21swapper/222:17:172
1583099674,22cyclictest0-21swapper/222:58:202
1583099674,22cyclictest0-21swapper/222:58:202
248599660,4rtkit-daemon2484-21rtkit-daemon20:57:362
248599660,4rtkit-daemon2484-21rtkit-daemon20:57:362
248599660,12rtkit-daemon0-21swapper/222:21:322
248599660,12rtkit-daemon0-21swapper/222:21:322
1583099664,38cyclictest0-21swapper/220:43:342
1583099664,38cyclictest0-21swapper/220:13:422
1583099664,38cyclictest0-21swapper/220:13:422
248599650,9rtkit-daemon0-21swapper/222:27:552
248599650,9rtkit-daemon0-21swapper/220:03:152
248599650,6rtkit-daemon0-21swapper/219:27:093
293122640,3sleep229316-21ssh22:40:402
248599640,9rtkit-daemon0-21swapper/218:59:552
248599640,7rtkit-daemon0-21swapper/220:38:442
248599640,12rtkit-daemon0-21swapper/219:44:162
248599640,12rtkit-daemon0-21swapper/217:55:132
248599640,11rtkit-daemon0-21swapper/222:37:542
248599640,11rtkit-daemon0-21swapper/219:35:092
248599640,11rtkit-daemon0-21swapper/219:35:092
19152643,52sleep20-21swapper/220:23:492
1583099645,14cyclictest1419-21runrttasks20:04:182
248599630,9rtkit-daemon0-21swapper/221:33:192
248599630,9rtkit-daemon0-21swapper/221:33:192
248599630,9rtkit-daemon0-21swapper/221:24:572
248599630,8rtkit-daemon0-21swapper/223:14:382
248599630,8rtkit-daemon0-21swapper/222:09:482
248599630,8rtkit-daemon0-21swapper/220:22:142
248599630,8rtkit-daemon0-21swapper/219:38:242
248599630,7rtkit-daemon0-21swapper/221:04:132
248599630,3rtkit-daemon0-21swapper/221:29:272
248599630,11rtkit-daemon0-21swapper/222:52:312
248599630,11rtkit-daemon0-21swapper/222:44:242
248599630,11rtkit-daemon0-21swapper/220:10:222
248599630,11rtkit-daemon0-21swapper/219:11:022
248599630,11rtkit-daemon0-21swapper/218:00:432
1582999634,52cyclictest29286-21cat21:03:511
1582999634,13cyclictest0-21swapper/120:43:521
248599620,9rtkit-daemon0-21swapper/221:46:042
248599620,9rtkit-daemon0-21swapper/219:53:382
248599620,9rtkit-daemon0-21swapper/219:50:232
248599620,9rtkit-daemon0-21swapper/218:51:562
248599620,9rtkit-daemon0-21swapper/218:51:562
248599620,8rtkit-daemon0-21swapper/220:50:512
248599620,8rtkit-daemon0-21swapper/219:16:472
248599620,8rtkit-daemon0-21swapper/219:03:252
248599620,8rtkit-daemon0-21swapper/218:56:482
248599620,8rtkit-daemon0-21swapper/218:03:272
248599620,7rtkit-daemon0-21swapper/222:53:542
248599620,7rtkit-daemon0-21swapper/222:53:542
248599620,7rtkit-daemon0-21swapper/219:29:322
248599620,7rtkit-daemon0-21swapper/219:23:542
248599620,7rtkit-daemon0-21swapper/218:09:502
248599620,7rtkit-daemon0-21swapper/218:09:502
248599620,11rtkit-daemon0-21swapper/221:48:412
248599620,11rtkit-daemon0-21swapper/219:18:472
248599620,10rtkit-daemon0-21swapper/221:08:582
248599610,9rtkit-daemon0-21swapper/222:28:252
248599610,7rtkit-daemon0-21swapper/222:04:332
248599610,7rtkit-daemon0-21swapper/221:53:182
248599610,7rtkit-daemon0-21swapper/218:43:332
248599610,3rtkit-daemon0-21swapper/221:58:182
248599610,2rtkit-daemon0-21swapper/220:29:442
15830996140,12cyclictest32142-21grep18:19:052
1582999615,13cyclictest0-21swapper/121:28:311
1582999614,15cyclictest0-21swapper/120:48:381
1582999614,14cyclictest0-21swapper/118:48:241
248599600,2rtkit-daemon0-21swapper/218:43:182
1582999604,13cyclictest0-21swapper/122:57:571
1582999604,13cyclictest0-21swapper/122:57:571
1582999604,13cyclictest0-21swapper/122:08:291
248599590,2rtkit-daemon0-21swapper/221:02:432
1582999595,11cyclictest0-21swapper/122:22:221
1582999595,11cyclictest0-21swapper/122:22:221
1582999594,12cyclictest11909-21sed20:38:431
1582999594,12cyclictest0-21swapper/119:58:421
1583199583,22cyclictest0-21swapper/318:53:393
1582999585,12cyclictest0-21swapper/121:35:461
1582999585,12cyclictest0-21swapper/121:35:461
1582999584,13cyclictest0-21swapper/120:33:591
1582999584,12cyclictest0-21swapper/123:11:021
1582999584,12cyclictest0-21swapper/122:23:481
1582999584,11cyclictest11663-21switchtime22:13:451
1582999584,11cyclictest11663-21switchtime22:13:451
15830995713,28cyclictest0-21swapper/223:11:482
1582999575,13cyclictest0-21swapper/121:09:081
1582999574,13cyclictest0-21swapper/120:23:011
1582999574,12cyclictest0-21swapper/120:13:481
1582999574,12cyclictest0-21swapper/120:13:481
15830995621,15cyclictest0-21swapper/218:23:382
1582999564,13cyclictest0-21swapper/122:44:431
1582999564,13cyclictest0-21swapper/120:28:481
1582999564,12cyclictest0-21swapper/121:39:291
1582999564,12cyclictest0-21swapper/118:58:241
178602552,46sleep10-21swapper/117:49:081
1582999554,12cyclictest0-21swapper/122:29:491
1582999553,46cyclictest0-21swapper/122:39:291
1583099546,31cyclictest0-21swapper/217:48:512
15830995435,11cyclictest3728-21gltestperf18:28:452
1582999546,29cyclictest0-21swapper/123:00:131
1582999546,29cyclictest0-21swapper/123:00:131
114502540,8sleep10-21swapper/119:51:331
1582999535,28cyclictest0-21swapper/122:38:151
1582999535,15cyclictest0-21swapper/122:50:001
1582999534,13cyclictest24057-21unixbench_multi21:43:501
15829995334,11cyclictest1758-21sendmail_mailqu18:23:541
15829995331,14cyclictest0-21swapper/120:24:001
275442523,11sleep10-21swapper/118:10:531
275442523,11sleep10-21swapper/118:10:531
248599520,5rtkit-daemon2484-21rtkit-daemon18:37:343
248599520,5rtkit-daemon2484-21rtkit-daemon17:47:363
1583099525,38cyclictest0-21swapper/218:18:252
1582999525,29cyclictest0-21swapper/122:01:421
1582999525,29cyclictest0-21swapper/121:22:111
1582999525,29cyclictest0-21swapper/120:03:451
1582999525,29cyclictest0-21swapper/119:53:381
1582999525,29cyclictest0-21swapper/119:33:511
1582999525,29cyclictest0-21swapper/119:33:511
1582999525,29cyclictest0-21swapper/119:08:551
1582999525,29cyclictest0-21swapper/118:58:441
1582999524,30cyclictest0-21swapper/119:18:581
15829995230,13cyclictest0-21swapper/120:08:361
15829995210,34cyclictest0-21swapper/121:28:171
15830995120,13cyclictest0-21swapper/217:48:262
1582999515,25cyclictest0-21swapper/122:07:051
1582999514,29cyclictest0-21swapper/121:56:001
1582999514,28cyclictest0-21swapper/123:06:571
15829995121,13cyclictest0-21swapper/123:13:371
15829995120,12cyclictest0-21swapper/121:14:181
15829995119,13cyclictest0-21swapper/118:18:551
48222503,40sleep10-21swapper/118:31:091
248599500,4rtkit-daemon2484-21rtkit-daemon18:28:563
15830995032,11cyclictest6988-21head18:33:582
1582999505,28cyclictest0-21swapper/119:13:441
1582999504,28cyclictest0-21swapper/120:56:081
1582999504,28cyclictest0-21swapper/120:56:081
1582999504,27cyclictest0-21swapper/119:03:421
1582999504,27cyclictest0-21swapper/118:34:001
1582999504,25cyclictest25950-21rm21:48:321
95902494,39sleep10-21swapper/118:40:521
250772493,39sleep10-21swapper/118:04:531
15829994917,13cyclictest0-21swapper/119:31:391
1582999484,28cyclictest0-21swapper/119:38:311
1583199479,21cyclictest0-21swapper/319:02:393
1582999475,34cyclictest0-21swapper/118:48:351
1582999475,34cyclictest0-21swapper/118:48:351
1582999474,35cyclictest0-21swapper/119:48:231
229112463,37sleep10-21swapper/118:02:431
1582999464,34cyclictest0-21swapper/119:23:391
1583199453,26cyclictest0-21swapper/318:44:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional