You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 06:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri May 22, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17198993021,5cyclictest10156-21sh00:28:291
17204992625,1cyclictest34-21ksoftirqd/323:20:103
17204992625,1cyclictest34-21ksoftirqd/323:20:103
17204992625,1cyclictest34-21ksoftirqd/322:14:423
17198992622,4cyclictest10464-21diskmemload23:26:181
1719899260,1cyclictest0-21swapper/122:56:241
1719899260,1cyclictest0-21swapper/121:10:101
17204992524,1cyclictest34-21ksoftirqd/320:20:013
1720099250,24cyclictest10464-21diskmemload22:37:432
17198992522,3cyclictest27615-21ssh22:22:081
17198992521,4cyclictest10464-21diskmemload22:09:221
17198992520,4cyclictest0-21swapper/123:36:061
17198992520,4cyclictest0-21swapper/123:03:511
17198992520,4cyclictest0-21swapper/122:19:031
1719899250,24cyclictest10464-21diskmemload00:36:351
1719899250,24cyclictest0-21swapper/123:57:161
1719899250,24cyclictest0-21swapper/121:38:501
1719899250,24cyclictest0-21swapper/121:26:451
1719899250,24cyclictest0-21swapper/121:21:461
1719899250,22cyclictest22874-21sh22:45:521
1719899250,21cyclictest0-21swapper/123:42:051
1719899250,21cyclictest0-21swapper/122:39:081
1719899250,20cyclictest0-21swapper/121:32:451
1719899250,1cyclictest0-21swapper/122:12:521
1719899250,0cyclictest0-21swapper/123:20:181
1719899250,0cyclictest0-21swapper/123:20:181
1719499250,24cyclictest10464-21diskmemload21:30:170
1719499250,24cyclictest0-21swapper/023:40:160
1719499250,24cyclictest0-21swapper/022:00:310
1719499250,1cyclictest24412-21ssh21:22:440
17204992422,1cyclictest0-21swapper/323:38:553
1720499240,24cyclictest0-21swapper/323:26:233
1720499240,23cyclictest0-21swapper/300:20:193
1720099240,3cyclictest28478-21ssh22:50:512
1720099240,24cyclictest6099-21ssh23:57:332
1720099240,24cyclictest0-21swapper/223:07:082
1720099240,1cyclictest12487-21rm23:32:572
1720099240,1cyclictest0-21swapper/223:37:232
17198992423,1cyclictest10464-21diskmemload21:10:011
17198992422,1cyclictest0-21swapper/100:12:491
17198992421,3cyclictest0-21swapper/123:50:561
17198992421,2cyclictest0-21swapper/100:31:141
17198992420,3cyclictest0-21swapper/123:32:541
17198992420,0cyclictest0-21swapper/122:34:231
1719899240,24cyclictest0-21swapper/123:14:221
1719899240,23cyclictest0-21swapper/123:46:301
1719899240,23cyclictest0-21swapper/123:16:131
1719899240,23cyclictest0-21swapper/122:40:171
1719899240,21cyclictest10464-21diskmemload22:01:591
1719899240,21cyclictest0-21swapper/122:25:101
1719899240,0cyclictest0-21swapper/100:00:551
17194992424,0cyclictest0-21swapper/021:59:240
17194992422,1cyclictest0-21swapper/023:45:360
17194992422,1cyclictest0-21swapper/021:11:570
1719499240,23cyclictest62550irq/127-eno123:00:260
1719499240,23cyclictest10464-21diskmemload23:12:470
1719499240,23cyclictest0-21swapper/023:38:590
1719499240,23cyclictest0-21swapper/022:25:550
1719499240,23cyclictest0-21swapper/022:13:030
1719499240,23cyclictest0-21swapper/021:16:400
1719499240,23cyclictest0-21swapper/000:07:460
1719499240,0cyclictest0-21swapper/022:32:450
17204992323,0cyclictest0-21swapper/322:53:233
17204992321,2cyclictest4670-21ssh22:01:383
1720499230,2cyclictest9633-21rm22:05:493
1720499230,23cyclictest10464-21diskmemload22:26:003
1720499230,23cyclictest10464-21diskmemload21:33:063
1720499230,23cyclictest0-21swapper/323:43:313
1720499230,23cyclictest0-21swapper/323:03:533
1720499230,23cyclictest0-21swapper/321:53:203
1720499230,23cyclictest0-21swapper/321:36:333
1720499230,23cyclictest0-21swapper/300:01:533
1720499230,22cyclictest931-21diskmemload21:57:503
1720499230,22cyclictest5591-21ssh22:30:553
1720499230,22cyclictest23428-21apt-get23:15:013
1720499230,22cyclictest0-21swapper/321:28:493
1720499230,0cyclictest10464-21diskmemload23:53:113
1720499230,0cyclictest0-21swapper/323:46:203
1720499230,0cyclictest0-21swapper/300:34:223
1720499230,0cyclictest0-21swapper/300:16:013
1720499230,0cyclictest0-21swapper/300:12:363
17200992323,0cyclictest10464-21diskmemload23:40:102
17200992323,0cyclictest10464-21diskmemload22:30:542
17200992323,0cyclictest10464-21diskmemload21:16:042
17200992323,0cyclictest0-21swapper/223:13:442
17200992323,0cyclictest0-21swapper/222:26:172
17200992323,0cyclictest0-21swapper/222:21:172
17200992323,0cyclictest0-21swapper/221:37:572
17200992323,0cyclictest0-21swapper/200:06:032
17200992323,0cyclictest0-21swapper/200:04:442
17200992321,1cyclictest6774-21munin-run19:55:002
17200992321,1cyclictest0-21swapper/200:13:262
17200992320,2cyclictest32163-21ssh21:57:412
17200992319,0cyclictest0-21swapper/221:32:332
1720099230,23cyclictest0-21swapper/223:24:052
1720099230,23cyclictest0-21swapper/223:24:052
1720099230,23cyclictest0-21swapper/222:04:242
1720099230,23cyclictest0-21swapper/221:40:332
1720099230,23cyclictest0-21swapper/221:20:322
1720099230,23cyclictest0-21swapper/200:31:192
1720099230,22cyclictest28554-21ssh21:25:462
1720099230,22cyclictest17241-21ssh00:35:112
1720099230,22cyclictest1675-21ssh22:55:552
1720099230,0cyclictest10464-21diskmemload21:12:052
1720099230,0cyclictest0-21swapper/221:52:292
1720099230,0cyclictest0-21swapper/200:23:332
17198992320,3cyclictest0-21swapper/123:05:071
17198992320,3cyclictest0-21swapper/122:54:071
1719899230,22cyclictest31192-21sh21:56:181
1719899230,22cyclictest10464-21diskmemload21:47:461
1719899230,20cyclictest0-21swapper/100:05:101
1719899230,0cyclictest0-21swapper/121:52:291
1719899230,0cyclictest0-21swapper/121:40:141
17194992323,0cyclictest10464-21diskmemload21:51:050
17194992323,0cyclictest0-21swapper/023:05:090
17194992323,0cyclictest0-21swapper/022:55:260
17194992323,0cyclictest0-21swapper/022:37:210
17194992323,0cyclictest0-21swapper/022:21:190
17194992323,0cyclictest0-21swapper/022:05:510
17194992323,0cyclictest0-21swapper/000:01:170
1719499232,21cyclictest62550irq/127-eno121:41:340
17194992321,1cyclictest0-21swapper/023:26:580
17194992321,1cyclictest0-21swapper/021:26:130
1719499230,2cyclictest30332-21sh23:21:000
1719499230,2cyclictest30332-21sh23:21:000
1719499230,23cyclictest10464-21diskmemload00:15:550
1719499230,23cyclictest0-21swapper/023:17:290
1719499230,23cyclictest0-21swapper/022:53:190
1719499230,23cyclictest0-21swapper/000:10:210
1719499230,22cyclictest9069-21rm23:30:410
1719499230,22cyclictest10472-21cron21:10:010
1719499230,22cyclictest10464-21diskmemload22:44:470
1719499230,22cyclictest0-21swapper/020:37:430
1719499230,21cyclictest0-21swapper/021:38:180
1719499230,0cyclictest0-21swapper/022:17:430
1719499230,0cyclictest0-21swapper/021:45:160
1719499230,0cyclictest0-21swapper/000:27:530
17204992222,0cyclictest0-21swapper/322:55:163
17204992222,0cyclictest0-21swapper/322:49:553
17204992222,0cyclictest0-21swapper/321:43:323
17204992222,0cyclictest0-21swapper/321:17:403
17204992221,1cyclictest10464-21diskmemload22:20:153
17204992220,2cyclictest10464-21diskmemload23:34:483
17204992220,1cyclictest11958-21sh21:11:123
17204992220,1cyclictest0-21swapper/300:26:163
1720499220,21cyclictest26803-21idleruntime-cro19:30:013
1720499220,21cyclictest20511-21ssh22:15:113
1720499220,21cyclictest13082-21ssh23:05:583
1720499220,21cyclictest10464-21diskmemload23:55:243
1720499220,21cyclictest0-21swapper/323:10:553
1720499220,1cyclictest23223-21ssh21:21:123
1720499220,1cyclictest22401-21ssh21:47:553
1720499220,1cyclictest20210-21ssh00:37:513
1720499220,1cyclictest15777-21sh22:39:433
17200992222,0cyclictest7181-21ssh23:00:352
17200992222,0cyclictest10464-21diskmemload23:50:032
17200992222,0cyclictest10464-21diskmemload00:29:582
17200992222,0cyclictest0-21swapper/223:25:202
17200992222,0cyclictest0-21swapper/222:49:172
17200992221,1cyclictest6110-21apt-get21:02:452
17200992221,1cyclictest19112-21ssh21:45:432
1720099220,21cyclictest26110-21ssh23:45:532
1720099220,21cyclictest20781-21ssh22:15:322
1720099220,21cyclictest16339-21ssh22:40:122
1720099220,1cyclictest32173-21ssh00:19:422
1720099220,1cyclictest25829-21ssh23:17:372
1720099220,1cyclictest20015-21sh22:14:532
1720099220,0cyclictest0-21swapper/222:05:342
17198992220,2cyclictest0-21swapper/121:17:111
17198992220,2cyclictest0-21swapper/100:15:131
1719899220,21cyclictest5637-21perf21:00:011
1719899220,21cyclictest3221-21awk20:55:001
1719899220,21cyclictest0-21swapper/119:17:431
1719899220,1cyclictest9253-21idleruntime-cro20:00:001
1719899220,1cyclictest0-21swapper/120:42:431
1719899220,1cyclictest0-21swapper/100:20:581
1719899220,0cyclictest0-21swapper/120:12:441
17194992222,0cyclictest0-21swapper/000:30:180
17194992220,1cyclictest9205-21cron20:00:000
17194992220,1cyclictest0-21swapper/023:55:450
1719499220,21cyclictest18830-21latency_hist20:20:010
1719499220,21cyclictest10464-21diskmemload00:35:200
1719499220,21cyclictest0-21swapper/023:50:130
1719499220,21cyclictest0-21swapper/020:27:430
1719499220,21cyclictest0-21swapper/019:42:440
1719499220,0cyclictest0-21swapper/000:24:410
17204992120,1cyclictest1649-21cron20:10:013
17204992119,1cyclictest1975-21basename19:45:003
1720499210,21cyclictest10464-21diskmemload00:05:243
1720499210,20cyclictest31310-21apt-get20:47:433
1720099210,20cyclictest0-21swapper/220:32:432
1720099210,1cyclictest0-21swapper/220:50:002
1719899210,0cyclictest0-21swapper/120:07:431
17194992121,0cyclictest0-21swapper/020:02:420
17194992119,1cyclictest21246-21perf20:25:010
17204992020,0cyclictest21703-21apt-get20:27:433
17204992020,0cyclictest0-21swapper/320:22:443
17204992018,1cyclictest0-21swapper/320:57:453
17200992020,0cyclictest20042-21apt-get19:17:432
17200992020,0cyclictest0-21swapper/219:27:432
17200992020,0cyclictest0-21swapper/219:22:442
17200992020,0cyclictest0-21swapper/219:12:432
17200992018,1cyclictest1969-21sh19:45:002
1720099200,0cyclictest26497-21apt-get20:37:432
17198992020,0cyclictest0-21swapper/119:27:441
1719899200,2cyclictest4374-21idleruntime-cro19:50:001
1719899200,2cyclictest31940-21sed20:47:461
1719899200,1cyclictest7735-21cat21:02:541
1719899200,0cyclictest0-21swapper/120:32:431
17194992020,0cyclictest0-21swapper/020:42:430
17194992020,0cyclictest0-21swapper/019:32:430
1719499200,19cyclictest0-21swapper/020:32:430
1719499200,0cyclictest24853-21apt-get19:27:430
17204991919,0cyclictest0-21swapper/320:02:423
17204991917,1cyclictest26041-21munin-run20:35:003
17204991917,1cyclictest0-21swapper/320:52:433
17200991919,0cyclictest8556-21apt-get21:07:452
17200991919,0cyclictest0-21swapper/219:35:022
17198991919,0cyclictest0-21swapper/119:42:441
17198991919,0cyclictest0-21swapper/119:37:431
17198991918,1cyclictest0-21swapper/120:37:431
1719899190,0cyclictest0-21swapper/119:22:441
17194991919,0cyclictest0-21swapper/019:22:440
17194991919,0cyclictest0-21swapper/019:17:430
17204991818,0cyclictest0-21swapper/321:07:453
17204991816,1cyclictest609-21rs:main3
17200991818,0cyclictest0-21swapper/220:02:422
17200991817,1cyclictest3692-21apt-get20:57:452
17198991817,1cyclictest18827-21dump-pmu-power20:20:011
17198991817,1cyclictest0-21swapper/119:32:431
1719899180,1cyclictest0-21swapper/119:52:471
1719899180,17cyclictest0-21swapper/120:27:431
17194991818,0cyclictest0-21swapper/019:37:420
1719499180,15cyclictest611-21irqbalance20:59:540
17204991717,0cyclictest30041-21apt-get19:37:423
17204991717,0cyclictest28916-21apt-get20:42:433
17204991716,1cyclictest22460-21apt-get19:22:443
17204991716,1cyclictest0-21swapper/319:12:443
17200991717,0cyclictest1283-21apt-get20:52:432
17200991717,0cyclictest0-21swapper/220:27:432
17200991717,0cyclictest0-21swapper/220:12:442
17194991717,0cyclictest0-21swapper/021:02:450
17194991717,0cyclictest0-21swapper/019:52:450
17194991716,0cyclictest0-21swapper/020:47:430
1720499160,15cyclictest0-21swapper/319:57:433
1720099164,11cyclictest611-21irqbalance20:07:242
17200991616,0cyclictest0-21swapper/219:47:422
17200991613,3cyclictest0-21swapper/220:44:092
17200991613,2cyclictest18858-21awk20:20:012
17198991616,0cyclictest0-21swapper/120:02:421
17198991616,0cyclictest0-21swapper/119:12:441
1719899160,15cyclictest0-21swapper/120:22:491
17194991616,0cyclictest4379-21perf19:50:000
1719499160,15cyclictest12736-21hddtemp_smartct20:07:450
17204991515,0cyclictest0-21swapper/320:37:433
17204991515,0cyclictest0-21swapper/320:10:413
17194991515,0cyclictest0-21swapper/020:12:440
1720499140,14cyclictest0-21swapper/321:00:433
1720499140,14cyclictest0-21swapper/319:50:023
1720499140,14cyclictest0-21swapper/319:45:393
1720499140,14cyclictest0-21swapper/319:30:343
17200991414,0cyclictest0-21swapper/219:30:522
1720099140,14cyclictest0-21swapper/219:55:232
1720099140,0cyclictest0-21swapper/220:20:272
1719499140,14cyclictest0-21swapper/020:50:350
1719499140,0cyclictest0-21swapper/019:11:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional