You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 18:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sat Jul 25, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
123770099178158,18cyclictest1528204-21munin-run12:00:010
123770799151146,3cyclictest1528245-21gpgv12:00:012
149768721070,1chrt1497686-21/usr/sbin/munin11:27:511
13543652880,3sleep20-21swapper/209:07:382
1237703998884,3cyclictest0-21swapper/112:00:011
13986262750,3sleep01237695-21cyclictest09:50:010
12517882690,2sleep3481ktimers/307:22:433
13244052540,2sleep3481ktimers/308:35:013
1237703995140,9cyclictest278-21systemd-journal07:35:001
1237703994940,6cyclictest1279748-21latency_hist07:50:011
1237703994536,6cyclictest1393460-21latency_hist09:45:011
1237703994439,3cyclictest4083219-21kworker/u8:0+events_unbound07:55:001
1237700994230,9cyclictest278-21systemd-journal09:35:010
1237703994132,6cyclictest1367987-21ntpq09:17:521
1237703994132,6cyclictest1367987-21ntpq09:17:511
1237703993935,3cyclictest1403578-21kworker/u8:2+flush-8:010:17:421
1237700993934,4cyclictest427027-21kworker/u8:2+events_unbound08:12:510
1237703993834,3cyclictest1442451-21kworker/u8:0+flush-8:010:59:511
123770099380,15cyclictest0-21swapper/009:37:380
1237703993729,5cyclictest278-21systemd-journal08:31:511
1237700993729,5cyclictest1344005-21latency_hist08:55:010
12374142374,9sleep10-21swapper/107:08:301
1237707993632,3cyclictest1518222-21kworker/u8:3+events_unbound12:20:032
1237700993630,4cyclictest1403578-21kworker/u8:2+flush-8:010:42:450
1237703993530,4cyclictest1503379-21kworker/u8:2+flush-8:012:32:471
1237703993530,3cyclictest1244343-21irqrtprio07:15:041
1237703993524,9cyclictest1258932-21ntpq07:27:501
1237700993530,3cyclictest1473359-21systemd-run11:05:000
1237700993530,3cyclictest1295210-21cpuspeed_turbos08:07:380
123770099349,12cyclictest1540362-21cat12:12:460
1237700993429,3cyclictest1305061-21tr08:17:410
1237700993427,5cyclictest1513991-21diskstats11:47:410
1237700993427,5cyclictest1513991-21diskstats11:47:410
1237700993412,20cyclictest1227819-21kworker/0:1+events07:32:450
123770099340,33cyclictest1447600-21sshd10:37:510
12373952344,10sleep20-21swapper/207:08:142
1237707993329,3cyclictest4083219-21kworker/u8:0+events_unbound09:22:572
123770099339,9cyclictest0-21swapper/007:52:540
123770799327,11cyclictest1473331-21idleruntime-cro11:05:002
1237707993221,8cyclictest1398488-21cp09:50:012
1237707993216,4cyclictest39-21ksoftirqd/210:17:392
1237703993223,7cyclictest1443099-21apt-get10:35:001
1237700993223,7cyclictest1349695-21diskstats09:02:390
1237700993212,11cyclictest0-21swapper/010:08:580
128865423117,9sleep30-21swapper/307:57:473
1237707993122,2cyclictest161rcu_preempt09:52:462
1237707993112,3cyclictest39-21ksoftirqd/208:32:402
1237703993126,4cyclictest1498149-21kworker/u8:0+flush-8:011:42:561
1237703993125,4cyclictest1260057-21kworker/u8:3+flush-8:008:27:441
1237703993125,4cyclictest1260057-21kworker/u8:3+events_unbound08:57:521
1237703993122,7cyclictest1238035-21/usr/sbin/munin07:12:481
123770099319,5cyclictest1344850-21basename08:57:430
1237700993126,3cyclictest1279753-21munin-plugin-st07:50:000
1237707993018,3cyclictest161rcu_preempt12:27:512
1237707993013,5cyclictest161rcu_preempt12:05:012
1237703993025,4cyclictest4083219-21kworker/u8:0+flush-8:009:47:401
1237703993025,3cyclictest1483675-21apt-get11:17:381
1237703993025,3cyclictest1371371-21kthreadcore09:22:451
1237703993021,7cyclictest1413477-21latency_hist10:05:011
1237703993020,8cyclictest1274581-21latency_hist07:45:001
123770099308,6cyclictest1521520-21cut11:52:450
123770099302,27cyclictest1498233-21kworker/0:0+events11:37:450
123770099302,27cyclictest1403582-21kworker/0:0+events10:12:450
1237700993021,2cyclictest161rcu_preempt12:16:130
1237700993020,7cyclictest278-21systemd-journal11:27:520
1237707992924,3cyclictest1433788-21aten2_r5power_v10:27:382
1237707992915,2cyclictest161rcu_preempt07:42:472
123770799290,10cyclictest1443104-21munin-run10:35:002
1237703992925,3cyclictest4083219-21kworker/u8:0+flush-8:008:22:411
1237703992925,3cyclictest1260057-21kworker/u8:3+events_unbound08:02:551
1237703992925,3cyclictest1260057-21kworker/u8:3+events_unbound08:02:551
1237703992924,4cyclictest1498149-21kworker/u8:0+events_unbound11:52:381
1237703992924,3cyclictest1534447-21irqrtprio12:07:421
1237703992923,5cyclictest1453194-21kworker/u8:1+flush-8:010:52:521
1237703992923,4cyclictest1260057-21kworker/u8:3+events_unbound09:12:441
1237703992922,5cyclictest1353908-21latency_hist09:05:011
123770399291,3cyclictest1344007-21munin-run08:55:001
123770099293,10cyclictest0-21swapper/010:17:380
1237700992924,3cyclictest1482419-21needreboot11:12:460
1237700992924,3cyclictest1294551-21turbostat.cron08:05:000
1237700992924,3cyclictest1294551-21turbostat.cron08:05:000
123770099291,17cyclictest578-21runrttasks07:37:360
123770099290,20cyclictest1314453-21latency_hist08:25:010
123770799288,5cyclictest1480958-21tr11:12:432
123770799287,12cyclictest1375934-21tr09:27:442
123770799285,7cyclictest1258478-21tr07:27:462
123770799285,10cyclictest1522940-21unixbench_multi11:52:552
123770799284,8cyclictest1347167-21cut08:57:472
123770799283,15cyclictest1261979-21cut07:32:452
123770799280,5cyclictest1448301-21munin-run10:40:002
123770799280,11cyclictest1492360-21awk11:22:482
1237703992823,3cyclictest1563585-21cpuspeed_turbos12:37:391
1237703992823,3cyclictest1324901-21cpuspeed_turbos08:37:401
1237703992822,4cyclictest1354581-21tr09:07:391
1237703992820,6cyclictest278-21systemd-journal09:40:001
1237703992819,7cyclictest4083219-21kworker/u8:0+flush-8:008:47:491
123770099284,6cyclictest1318997-21awk08:27:560
123770099284,13cyclictest0-21swapper/009:42:380
123770099283,9cyclictest1285656-21ps07:57:420
1237700992822,4cyclictest0-21swapper/012:40:000
1237700992822,3cyclictest0-21swapper/010:55:000
1237700992812,9cyclictest0-21swapper/011:32:430
1237700992812,5cyclictest1363298-21sensors_temp09:12:550
123770799275,7cyclictest1458524-21date10:50:012
1237707992724,2cyclictest1409096-21aten2_r5power_v10:02:392
1237707992723,3cyclictest1338806-21unixbench_multi08:47:552
1237707992716,3cyclictest161rcu_preempt12:35:002
1237707992713,2cyclictest161rcu_preempt09:20:002
1237707992713,2cyclictest161rcu_preempt09:20:002
1237707992713,2cyclictest161rcu_preempt07:57:552
123770799270,14cyclictest1474549-21sed11:07:432
123770799270,13cyclictest1294546-21cron08:05:002
123770799270,13cyclictest1294546-21cron08:05:002
1237703992722,4cyclictest1498149-21kworker/u8:0+events_unbound11:37:401
1237703992722,3cyclictest395-21dbus-daemon11:50:001
1237703992722,3cyclictest395-21dbus-daemon11:50:001
1237703992721,5cyclictest1414151-21cpuspeed_turbos10:07:401
123770099277,4cyclictest1373105-21processes09:22:530
123770099275,14cyclictest1552315-21ntpq12:22:490
123770099273,10cyclictest0-21swapper/008:47:370
1237700992723,3cyclictest1254458-21cron07:25:000
1237700992722,3cyclictest395-21dbus-daemon10:25:000
1237700992719,6cyclictest1513299-21latency_hist11:45:000
1237700992718,6cyclictest1242648-21latency_hist07:15:010
1237700992716,9cyclictest278-21systemd-journal12:05:010
123770099271,23cyclictest1-21systemd11:00:000
1237700992711,9cyclictest0-21swapper/009:27:450
123770099271,15cyclictest1333655-21sensors_volt08:42:540
1237700992710,3cyclictest1562434-21python312:32:550
123770099270,13cyclictest1358994-21latency_hist09:10:000
123770799267,9cyclictest1467636-21awk10:57:532
123770799267,6cyclictest39-21ksoftirqd/208:25:012
123770799267,5cyclictest1342362-21tr08:52:442
123770799264,5cyclictest0-21swapper/209:12:422
123770799263,6cyclictest1484820-21tr11:17:462
1237707992613,1cyclictest161rcu_preempt12:13:512
123770799261,13cyclictest1543578-21apt-get12:17:392
123770799260,8cyclictest1352647-21cut09:02:452
123770799260,11cyclictest1247071-21cut07:17:452
1237703992622,3cyclictest4083219-21kworker/u8:0+flush-8:009:30:311
1237703992622,3cyclictest1442451-21kworker/u8:0+events_unbound11:02:421
1237703992622,3cyclictest0-21swapper/111:25:011
1237703992621,3cyclictest1557732-21unixbench_multi12:27:571
1237703992621,3cyclictest1304225-21kworker/u8:1+flush-8:008:17:551
1237703992621,3cyclictest1-21systemd08:10:001
1237703992619,5cyclictest1442451-21kworker/u8:0+events_unbound11:12:461
123770099268,3cyclictest13-21ksoftirqd/007:27:450
123770099266,11cyclictest1274557-21sshd07:44:520
1237700992620,4cyclictest1492885-21unixbench_multi11:22:560
1237700992612,8cyclictest161rcu_preempt10:47:450
1237700992611,9cyclictest0-21swapper/012:07:440
123770799256,8cyclictest1330497-21grep08:42:442
123770799254,6cyclictest1387010-21tr09:37:462
123770799253,11cyclictest0-21swapper/212:37:442
123770799252,4cyclictest1305062-21tr08:17:402
123770799252,4cyclictest0-21swapper/212:07:392
1237707992521,2cyclictest1414004-21aten2_r5power_p10:07:402
1237707992513,2cyclictest161rcu_preempt09:57:452
123770799250,9cyclictest1516811-21cut11:47:472
123770799250,9cyclictest1516811-21cut11:47:472
123770799250,9cyclictest1497780-21cut11:27:522
123770799250,9cyclictest1452577-21ntpq10:42:512
123770799250,9cyclictest1422032-21cut10:12:472
123770799250,9cyclictest1266677-21cut07:37:442
123770799250,8cyclictest1301590-21tr08:12:472
123770799250,8cyclictest1295811-21cut08:07:422
123770799250,10cyclictest1391821-21cut09:42:462
1237703992521,3cyclictest1453194-21kworker/u8:1+flush-8:011:32:531
1237703992521,3cyclictest1413699-21kworker/u8:3+flush-8:010:37:421
1237703992520,4cyclictest1453194-21kworker/u8:1+events_unbound10:47:521
1237703992520,3cyclictest1250188-21cpuspeed_turbos07:22:381
123770099258,3cyclictest0-21swapper/010:02:500
123770099258,16cyclictest1458364-21kworker/0:1+events11:17:450
123770099256,8cyclictest1473699-21sshd11:06:520
123770099252,8cyclictest1321326-21cut08:32:450
1237700992521,2cyclictest0-21swapper/009:52:530
1237700992511,2cyclictest0-21swapper/012:27:470
123770799244,4cyclictest0-21swapper/208:37:462
123770799243,7cyclictest1281888-21cut07:52:452
123770799241,8cyclictest39-21ksoftirqd/211:32:432
123770799241,7cyclictest39-21ksoftirqd/207:47:452
123770799240,9cyclictest1512727-21awk11:42:542
123770799240,9cyclictest1382918-21sshd09:32:512
123770799240,14cyclictest1253979-21mailstats07:22:522
1237703992419,4cyclictest1269422-21unixbench_singl07:37:561
1237703992419,3cyclictest1474499-21irqrtprio11:07:431
1237703992419,3cyclictest0-21swapper/108:00:001
1237703992418,4cyclictest1547896-21unixbench_singl12:17:571
1237703992418,4cyclictest1542921-21unixbench_singl12:12:581
123770099248,4cyclictest1434165-21if_err_enp4s010:27:420
123770099240,17cyclictest1438611-21apt-get10:32:360
12330092243,3sleep00-21swapper/007:06:320
123770799234,10cyclictest0-21swapper/210:22:372
123770799230,9cyclictest1505114-21cut11:37:452
123770799230,8cyclictest1459664-21cut10:52:442
123770799230,8cyclictest1315692-21cut08:27:442
123770799230,8cyclictest1240306-21cut07:12:452
1237703992318,3cyclictest1532590-21ntpq12:02:501
1237703992317,4cyclictest1299929-21apt-get08:12:381
1237703992316,5cyclictest278-21systemd-journal10:25:521
1237703992314,7cyclictest278-21systemd-journal10:44:521
123770099239,2cyclictest161rcu_preempt09:15:220
123770099239,2cyclictest161rcu_preempt09:15:220
123770099232,9cyclictest0-21swapper/009:57:530
1237700992317,4cyclictest1325197-21sort08:37:440
123770099220,11cyclictest1242854-21munin-node07:15:040
1237703992117,2cyclictest0-21swapper/110:12:391
1237703992117,2cyclictest0-21swapper/109:52:411
1237703992114,5cyclictest1331565-21kthreadcore08:42:451
1237703992110,8cyclictest278-21systemd-journal10:20:511
1237703992017,2cyclictest0-21swapper/112:22:521
1237703992016,3cyclictest1363556-21kworker/u8:1+flush-8:009:57:541
1237703991913,5cyclictest1329170-21kworker/u8:2+flush-8:009:27:501
12333662193,9sleep30-21swapper/307:07:393
15621542155,6sleep30-21swapper/312:32:503
14728562141,9sleep30-21swapper/311:02:553
15033462132,6sleep30-21swapper/311:35:013
14783032132,6sleep30-21swapper/311:10:023
14638522133,6sleep30-21swapper/310:57:413
14633842132,7sleep30-21swapper/310:55:013
14226132132,7sleep30-21swapper/310:12:523
13938782132,7sleep30-21swapper/309:47:363
13588322132,6sleep30-21swapper/309:10:013
13298382136,5sleep30-21swapper/308:42:403
15521212122,6sleep30-21swapper/312:22:473
15431132122,6sleep30-21swapper/312:15:013
15337012122,6sleep30-21swapper/312:07:353
15290782122,6sleep30-21swapper/312:02:413
15186672122,6sleep30-21swapper/311:52:383
15172432123,6sleep30-21swapper/311:47:493
15172432123,6sleep30-21swapper/311:47:493
14746632122,6sleep30-21swapper/311:07:443
14487322123,5sleep30-21swapper/310:42:373
14435572122,6sleep30-21swapper/310:35:023
14381882122,6sleep30-21swapper/310:30:013
14134962122,6sleep30-21swapper/310:05:013
14130302122,6sleep30-21swapper/310:02:573
13889522122,6sleep30-21swapper/309:42:393
13839902122,6sleep30-21swapper/309:37:373
13796762122,6sleep30-21swapper/309:32:443
13738192122,6sleep30-21swapper/309:25:013
13679682122,6sleep30-21swapper/309:17:513
13679682122,6sleep30-21swapper/309:17:513
13543312122,5sleep30-21swapper/309:07:363
13480202122,6sleep30-21swapper/308:57:493
13341432122,5sleep30-21swapper/308:45:013
13246712122,6sleep30-21swapper/308:37:393
13192472123,6sleep30-21swapper/308:30:003
13050062122,6sleep30-21swapper/308:17:413
13009422123,6sleep30-21swapper/308:12:473
12810832122,6sleep30-21swapper/307:52:453
12757522122,6sleep30-21swapper/307:47:443
12696722122,6sleep30-21swapper/307:40:023
12664272122,6sleep30-21swapper/307:37:453
12605462122,6sleep30-21swapper/307:32:433
12487872122,6sleep30-21swapper/307:17:513
12424642122,6sleep30-21swapper/307:12:583
15631972112,6sleep30-21swapper/312:35:513
15534192112,6sleep30-21swapper/312:27:213
15474392112,5sleep30-21swapper/312:17:543
15234712112,6sleep30-21swapper/311:55:513
15086562113,5sleep30-21swapper/311:41:353
14937892112,5sleep30-21swapper/311:27:353
14884902112,6sleep30-21swapper/311:21:083
14834532112,6sleep30-21swapper/311:15:073
14575932112,6sleep30-21swapper/310:47:543
14374952112,5sleep30-21swapper/310:27:523
14325182112,5sleep30-21swapper/310:22:513
14236372112,6sleep30-21swapper/310:16:013
14040112112,5sleep30-21swapper/309:57:393
13989842112,6sleep30-21swapper/309:51:493
13694612112,6sleep30-21swapper/309:22:413
13495162112,5sleep30-21swapper/309:02:383
13392902112,6sleep30-21swapper/308:50:033
13118642113,5sleep30-21swapper/308:22:463
12945712112,5sleep30-21swapper/308:05:013
12899202112,5sleep30-21swapper/308:00:523
12899202112,5sleep30-21swapper/308:00:523
12550802112,5sleep30-21swapper/307:27:023
14985792102,5sleep30-21swapper/311:30:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional