You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 03:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue May 19, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1270699922,82cyclictest240101munin-node21:32:531
259212910,5sleep125922-21cat17:08:111
1270699893,49cyclictest0-21swapper/122:02:401
1270699884,76cyclictest0-21swapper/120:28:571
1270699883,53cyclictest31096-21cpuspeed_turbos21:42:461
1270699874,65cyclictest0-21swapper/120:42:331
1270699874,63cyclictest0-21swapper/119:43:061
1270699874,63cyclictest0-21swapper/119:43:061
1270699873,78cyclictest0-21swapper/120:35:091
1270699873,77cyclictest0-21swapper/121:32:051
1270699864,74cyclictest0-21swapper/121:47:531
1270699864,64cyclictest0-21swapper/119:37:501
1270699863,77cyclictest0-21swapper/118:51:341
1270699863,75cyclictest30785-21ssh20:07:131
1270699854,74cyclictest0-21swapper/120:52:251
1270699854,62cyclictest0-21swapper/121:12:521
1270699854,56cyclictest0-21swapper/118:43:011
1270699853,74cyclictest0-21swapper/121:53:531
1270699853,46cyclictest121850irq/46-eth020:52:481
1270699849,67cyclictest18092-21cpuspeed_turbos19:47:511
1270699844,72cyclictest4523-21cpuspeed_turbos19:27:501
1270699844,63cyclictest0-21swapper/116:57:421
1270699843,74cyclictest0-21swapper/119:19:391
1270699834,72cyclictest0-21swapper/121:38:031
1270699834,72cyclictest0-21swapper/118:18:131
1270699834,71cyclictest1308-21diskstats19:22:521
1270699834,64cyclictest0-21swapper/119:52:561
1270699834,57cyclictest0-21swapper/121:57:471
1270699833,73cyclictest0-21swapper/121:03:221
1270699833,73cyclictest0-21swapper/120:57:471
1270699833,73cyclictest0-21swapper/120:57:471
1270699833,73cyclictest0-21swapper/120:24:451
1270699833,73cyclictest0-21swapper/119:03:401
1270699833,73cyclictest0-21swapper/119:03:401
1270699833,72cyclictest0-21swapper/119:11:051
1270699833,71cyclictest16421-21sh22:07:541
1270699833,62cyclictest14824-21runrttasks18:54:191
1270699824,71cyclictest0-21swapper/119:33:081
1270699824,71cyclictest0-21swapper/117:13:011
1270699823,72cyclictest3314-21iostat20:12:551
1270699823,72cyclictest0-21swapper/119:00:061
1270699823,71cyclictest14174-21sort21:17:491
1270699813,71cyclictest7051munin-node18:33:091
1270699813,70cyclictest1287-21snmpd16:58:401
1270699813,70cyclictest1287-21snmpd16:58:401
1270699813,70cyclictest0-21swapper/119:57:491
1270699813,60cyclictest1419-21runrttasks20:43:571
1270699813,59cyclictest29282-21sh18:22:591
1270699813,59cyclictest29282-21sh18:22:591
1270699813,51cyclictest14450-21munin-node17:52:511
248599800,5rtkit-daemon2484-21rtkit-daemon20:32:352
1270699804,69cyclictest0-21swapper/120:08:001
1270699804,61cyclictest0-21swapper/116:48:111
1270699804,58cyclictest0-21swapper/119:13:031
1270699804,47cyclictest9383-21ssh21:09:361
1270699803,71cyclictest0-21swapper/118:42:391
1270699803,70cyclictest17672-21df21:22:471
1270699803,70cyclictest0-21swapper/117:29:001
1270699794,68cyclictest0-21swapper/116:43:091
1270699793,68cyclictest1247-21lldpd17:03:421
1270699793,56cyclictest0-21swapper/120:17:581
1270699793,56cyclictest0-21swapper/120:17:581
1270699784,66cyclictest0-21swapper/117:37:581
1270699784,66cyclictest0-21swapper/117:37:581
1270699783,56cyclictest0-21swapper/117:32:591
1270699774,57cyclictest0-21swapper/118:02:401
1270699773,59cyclictest0-21swapper/118:12:521
1270699773,56cyclictest0-21swapper/117:23:011
1270699772,57cyclictest11675-21munin-node17:48:021
1270699753,65cyclictest462-21idleruntime-cro18:32:391
1270699753,65cyclictest21859-21grep18:07:581
12706997523,32cyclictest0-21swapper/118:03:091
12705997545,13cyclictest0-21swapper/020:57:140
1270699743,64cyclictest10248-21basename17:43:011
1270699703,60cyclictest0-21swapper/117:20:421
185032697,12sleep00-21swapper/021:22:590
1270599684,23cyclictest1868-21ssh20:12:340
12705996637,14cyclictest0-21swapper/018:52:570
12705996635,14cyclictest0-21swapper/019:37:490
1270899653,54cyclictest0-21swapper/321:47:443
12705996535,13cyclictest0-21swapper/021:52:480
12705996535,13cyclictest0-21swapper/019:57:570
1270799643,31cyclictest0-21swapper/219:07:572
12705996436,13cyclictest0-21swapper/020:12:540
1270799634,10cyclictest4083-21grep20:13:072
12707996313,31cyclictest0-21swapper/219:07:372
12707996313,31cyclictest0-21swapper/219:07:372
12705996335,13cyclictest0-21swapper/020:27:320
12705996333,13cyclictest0-21swapper/019:51:490
12705996332,13cyclictest0-21swapper/021:17:330
12705996332,13cyclictest0-21swapper/020:02:580
248599620,4rtkit-daemon2484-21rtkit-daemon16:43:063
1270899623,52cyclictest0-21swapper/320:32:553
1270699624,52cyclictest0-21swapper/116:42:421
1270899613,50cyclictest0-21swapper/318:58:003
1270799613,13cyclictest0-21swapper/221:27:462
12705996131,14cyclictest0-21swapper/021:17:590
1270899603,50cyclictest27907-21munin-node19:13:073
1270799605,13cyclictest0-21swapper/219:48:132
1270799604,13cyclictest0-21swapper/220:24:282
12705996037,9cyclictest17330-21taskset22:08:370
12705996032,13cyclictest0-21swapper/020:17:460
12705996032,13cyclictest0-21swapper/020:17:460
1270899594,47cyclictest0-21swapper/319:47:363
1270899594,47cyclictest0-21swapper/319:47:363
1270899593,49cyclictest0-21swapper/321:28:493
1270599594,30cyclictest0-21swapper/020:28:390
12705995932,12cyclictest0-21swapper/017:52:550
12705995927,20cyclictest0-21swapper/022:03:440
12705995912,29cyclictest0-21swapper/019:32:500
47622582,10sleep00-21swapper/017:32:540
271942584,47sleep20-21swapper/220:48:022
1270899583,47cyclictest0-21swapper/321:44:253
1270899583,47cyclictest0-21swapper/319:28:493
12708995821,23cyclictest18861-21kworker/3:020:51:583
12708995816,24cyclictest0-21swapper/319:37:583
1270799585,13cyclictest0-21swapper/221:34:252
1270799585,13cyclictest0-21swapper/219:18:302
1270799585,12cyclictest0-21swapper/217:22:592
1270799584,13cyclictest0-21swapper/220:11:572
1270799584,13cyclictest0-21swapper/218:59:162
12705995838,11cyclictest10029-21grep17:42:590
12705995833,10cyclictest8213-21latency21:07:550
12705995828,13cyclictest0-21swapper/020:40:220
12705995827,13cyclictest0-21swapper/020:58:080
12705995827,13cyclictest0-21swapper/020:58:080
248599570,5rtkit-daemon2484-21rtkit-daemon19:28:452
1270899574,47cyclictest0-21swapper/321:57:413
1270899574,46cyclictest0-21swapper/319:53:113
1270899574,46cyclictest0-21swapper/319:08:403
1270899573,48cyclictest0-21swapper/321:08:443
1270899573,48cyclictest0-21swapper/319:36:443
1270899573,48cyclictest0-21swapper/319:04:013
1270899573,48cyclictest0-21swapper/319:04:013
1270899573,48cyclictest0-21swapper/317:47:503
1270899573,47cyclictest0-21swapper/320:18:043
1270899573,47cyclictest0-21swapper/320:18:043
1270799575,12cyclictest0-21swapper/222:09:332
1270799574,15cyclictest0-21swapper/220:43:472
1270799574,14cyclictest0-21swapper/221:57:402
1270799574,13cyclictest0-21swapper/222:02:532
1270799574,13cyclictest0-21swapper/221:07:522
1270799574,13cyclictest0-21swapper/219:42:592
1270799574,13cyclictest0-21swapper/219:42:592
1270799574,12cyclictest0-21swapper/221:02:332
1270799574,12cyclictest0-21swapper/221:02:332
1270799574,12cyclictest0-21swapper/220:36:112
1270799574,12cyclictest0-21swapper/218:44:132
12707995724,27cyclictest29460-21cpu20:52:472
1270599574,45cyclictest0-21swapper/019:42:470
1270599574,45cyclictest0-21swapper/019:42:470
12705995731,11cyclictest0-21swapper/019:57:360
12705995727,13cyclictest16984-21wc20:33:000
82962562,45sleep00-21swapper/018:45:540
12708995632,10cyclictest1419-21runrttasks21:37:493
1270899563,47cyclictest16350-21iostat22:07:523
1270899563,47cyclictest0-21swapper/320:46:123
1270899563,47cyclictest0-21swapper/318:51:003
1270899562,48cyclictest0-21swapper/320:53:533
12708995616,33cyclictest26121-21timerwakeupswit19:58:083
1270799565,31cyclictest0-21swapper/218:33:102
1270799565,14cyclictest0-21swapper/221:24:572
1270799565,14cyclictest0-21swapper/218:55:002
1270799565,13cyclictest0-21swapper/219:52:432
1270799564,13cyclictest0-21swapper/221:04:562
1270799564,13cyclictest0-21swapper/219:32:562
1270799564,13cyclictest0-21swapper/218:17:392
1270799564,12cyclictest14516-21cut21:17:532
1270599564,36cyclictest0-21swapper/020:42:390
12705995628,12cyclictest0-21swapper/018:33:010
248599550,5rtkit-daemon2484-21rtkit-daemon20:17:582
248599550,5rtkit-daemon2484-21rtkit-daemon20:17:582
248599550,5rtkit-daemon2484-21rtkit-daemon18:42:392
1270899554,46cyclictest0-21swapper/321:54:483
1270899554,43cyclictest11061-21diskstats21:12:493
1270899553,47cyclictest0-21swapper/318:56:443
1270899553,44cyclictest0-21swapper/320:02:543
1270899552,47cyclictest0-21swapper/319:17:513
1270799555,32cyclictest0-21swapper/218:23:002
1270799555,32cyclictest0-21swapper/218:23:002
1270799555,30cyclictest0-21swapper/217:27:532
1270799555,14cyclictest0-21swapper/220:04:592
1270799555,13cyclictest0-21swapper/220:01:482
1270799553,46cyclictest0-21swapper/220:38:032
1270799553,12cyclictest0-21swapper/219:40:172
1270599555,35cyclictest0-21swapper/021:46:190
1270599555,15cyclictest0-21swapper/021:38:510
1270599555,15cyclictest0-21swapper/019:13:280
1270599554,34cyclictest0-21swapper/019:17:450
1270599554,31cyclictest0-21swapper/018:12:390
1270599553,45cyclictest0-21swapper/021:34:290
12705995527,10cyclictest17145-21ssh18:58:000
87642542,10sleep00-21swapper/017:38:590
87642542,10sleep00-21swapper/017:38:590
72032542,9sleep20-21swapper/221:53:332
248599540,5rtkit-daemon2484-21rtkit-daemon20:38:053
248599540,5rtkit-daemon2484-21rtkit-daemon17:03:062
244522542,9sleep00-21swapper/017:05:330
182132543,45sleep318283-21sh21:22:543
151842543,45sleep30-21swapper/320:31:313
1270899544,45cyclictest0-21swapper/317:34:013
12708995437,10cyclictest18074-21cut19:47:503
1270899543,45cyclictest0-21swapper/317:08:213
1270899543,44cyclictest27203-21sh21:37:323
1270899543,44cyclictest0-21swapper/317:52:573
1270799545,30cyclictest0-21swapper/217:38:012
1270799545,30cyclictest0-21swapper/217:38:012
1270799545,28cyclictest0-21swapper/217:17:542
1270799544,27cyclictest0-21swapper/221:17:032
1270799544,13cyclictest0-21swapper/221:44:032
1270599544,30cyclictest5968-21ssh21:04:270
1270599544,13cyclictest0-21swapper/020:47:580
113412543,7sleep311345-21rm20:24:493
248599530,5rtkit-daemon2484-21rtkit-daemon22:02:543
248599530,5rtkit-daemon2484-21rtkit-daemon17:47:412
1270899534,44cyclictest0-21swapper/319:26:103
1270899533,45cyclictest0-21swapper/318:47:353
1270899533,44cyclictest0-21swapper/318:03:083
1270799536,28cyclictest0-21swapper/221:47:432
1270799535,30cyclictest0-21swapper/217:33:142
1270799534,28cyclictest0-21swapper/218:27:502
1270799534,23cyclictest0-21swapper/219:12:532
1270799533,39cyclictest27997-21ssh21:37:492
1270799533,34cyclictest0-21swapper/217:08:222
12707995313,23cyclictest0-21swapper/219:23:082
1270599535,28cyclictest0-21swapper/019:24:090
1270599534,30cyclictest0-21swapper/018:38:060
12705995331,16cyclictest0-21swapper/018:02:500
12705995331,13cyclictest4887-21grep19:27:540
12705995330,11cyclictest0-21swapper/021:59:360
1270599533,37cyclictest0-21swapper/018:14:080
12705995325,10cyclictest5439-21diskmemload21:47:560
12705995311,26cyclictest0-21swapper/019:11:430
278192522,10sleep00-21swapper/018:18:250
248482522,43sleep00-21swapper/017:07:470
1270899527,37cyclictest0-21swapper/320:12:473
1270899524,42cyclictest0-21swapper/321:19:263
1270899523,44cyclictest0-21swapper/320:58:253
1270899523,44cyclictest0-21swapper/320:58:253
1270799524,30cyclictest0-21swapper/216:43:142
1270799524,29cyclictest0-21swapper/218:52:152
1270599524,31cyclictest0-21swapper/016:53:400
1270599524,29cyclictest0-21swapper/017:18:150
1270599524,29cyclictest0-21swapper/017:13:000
1270599523,45cyclictest0-21swapper/019:03:130
1270599523,45cyclictest0-21swapper/019:03:130
1270599523,43cyclictest0-21swapper/016:57:590
1270599523,43cyclictest0-21swapper/016:57:590
32322512,42sleep00-21swapper/017:28:060
164582512,9sleep30-21swapper/317:57:483
1270899515,41cyclictest0-21swapper/318:27:533
1270899513,43cyclictest0-21swapper/318:33:003
1270899513,42cyclictest0-21swapper/317:42:533
1270899513,27cyclictest0-21swapper/320:08:043
1270799515,28cyclictest0-21swapper/218:03:002
1270799514,30cyclictest0-21swapper/216:58:052
1270799514,30cyclictest0-21swapper/216:58:052
1270799514,29cyclictest0-21swapper/218:17:542
1270799514,29cyclictest0-21swapper/217:47:542
1270799514,28cyclictest0-21swapper/216:57:422
1270599514,26cyclictest0-21swapper/021:27:420
1270599513,25cyclictest0-21swapper/016:47:560
12705995128,10cyclictest0-21swapper/018:47:570
304962502,11sleep00-21swapper/018:27:070
304962502,11sleep00-21swapper/018:27:070
248599500,4rtkit-daemon2484-21rtkit-daemon17:12:582
1270899504,39cyclictest0-21swapper/318:13:063
12708995035,9cyclictest7751-21tail17:38:003
12708995035,9cyclictest7751-21tail17:38:003
1270899503,42cyclictest0-21swapper/317:29:003
1270899503,42cyclictest0-21swapper/317:18:123
1270899503,41cyclictest0-21swapper/321:02:383
1270899503,41cyclictest0-21swapper/318:23:423
1270899503,41cyclictest0-21swapper/318:23:423
1270899503,41cyclictest0-21swapper/316:48:003
1270799504,28cyclictest0-21swapper/217:58:082
1270599504,29cyclictest0-21swapper/018:28:140
1270599504,29cyclictest0-21swapper/017:47:560
1270899493,40cyclictest0-21swapper/318:17:543
12708994920,13cyclictest0-21swapper/317:17:423
1270799494,26cyclictest0-21swapper/217:54:052
12707994917,14cyclictest0-21swapper/218:08:102
143352482,39sleep00-21swapper/016:43:130
1270899483,40cyclictest0-21swapper/318:39:133
1270899483,39cyclictest0-21swapper/316:57:533
1270899483,39cyclictest0-21swapper/316:57:533
1270799484,28cyclictest0-21swapper/216:52:432
1270599484,27cyclictest0-21swapper/017:22:530
186062472,10sleep00-21swapper/018:02:370
1270899465,33cyclictest0-21swapper/317:23:053
1270899463,38cyclictest0-21swapper/316:52:543
1270899443,37cyclictest0-21swapper/318:09:083
1270899433,35cyclictest23775-21open_inodes17:03:103
123872434,6sleep30-21swapper/316:39:053
1270599413,24cyclictest0-21swapper/016:42:430
1270799392,18cyclictest12684-21latency_hist16:42:432
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional