You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 19:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Aug 07, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
161165523700,3sleep3575-21kworker/3:2+events12:27:563
129452799133125,6cyclictest1460272-21gpgv09:55:002
1294519997759,16cyclictest1460285-21sed09:55:000
1294522996966,2cyclictest0-21swapper/109:55:001
14816522630,1sleep21481655-21kthreadcore10:17:562
15474482600,6sleep20-21swapper/211:22:552
15120352570,6chrt0-21swapper/210:47:562
16066362560,2sleep21606639-21kthreadcore12:22:572
1294522995243,7cyclictest1306954-21/usr/sbin/munin07:23:041
1294527995040,7cyclictest275-21systemd-journal09:15:002
13922332490,5chrt0-21swapper/308:47:523
1294522994945,3cyclictest1609907-21kworker/u8:0+flush-8:012:37:521
1294522994945,3cyclictest1609907-21kworker/u8:0+flush-8:012:37:511
1294519994944,4cyclictest1559911-21kworker/u8:2+events_unbound11:43:050
1294522994742,3cyclictest1430614-21kworker/u8:1+events_unbound09:35:011
1294522994641,4cyclictest1496243-21kworker/u8:3+flush-8:011:38:051
1294522994534,9cyclictest275-21systemd-journal11:10:001
1294522994337,4cyclictest1585152-21kworker/u8:1+events_unbound12:28:071
1294519994234,6cyclictest1395765-21latency_hist08:50:010
1294522994137,3cyclictest1460498-21kworker/u8:1+events_unbound10:17:541
1294522994134,6cyclictest4130059-21kworker/u8:3+flush-8:008:13:091
1294519994133,6cyclictest1360915-21latency_hist08:15:010
1294522994035,3cyclictest1460498-21kworker/u8:1+flush-8:011:23:051
1294522994034,4cyclictest4130059-21kworker/u8:3+events_unbound08:25:001
1294522994034,4cyclictest1360938-21kworker/u8:2+flush-8:009:27:551
1294522993934,4cyclictest1559911-21kworker/u8:2+events_unbound11:47:581
1294522993932,5cyclictest1525102-21kworker/u8:0+flush-8:011:57:541
1294522993931,6cyclictest1365878-21latency_hist08:20:011
1294519993934,3cyclictest1440269-21cron09:35:000
1294519993931,6cyclictest1554722-21latency_hist11:30:010
128969223926,10sleep20-21swapper/207:05:122
1294527993832,4cyclictest1539666-21apt-get11:15:032
1294522993833,4cyclictest1460498-21kworker/u8:1+events_unbound10:25:011
1294522993833,3cyclictest1366135-21kworker/u8:0+flush-8:009:02:501
1294522993828,8cyclictest1385182-21ntpq08:38:001
1294522993828,8cyclictest1385182-21ntpq08:38:001
1294519993832,4cyclictest1299394-21gpgv07:15:010
1294522993732,4cyclictest1470179-21kworker/u8:2+flush-8:010:58:041
1294522993729,6cyclictest1415527-21latency_hist09:10:011
12942962374,9sleep10-21swapper/107:09:251
1294522993632,3cyclictest1460498-21kworker/u8:1+events_unbound10:27:501
1294522993631,4cyclictest1496243-21kworker/u8:3+events_unbound11:27:501
1294522993631,3cyclictest1410585-21kworker/u8:1+flush-8:009:12:491
1294522993627,6cyclictest1336252-21latency_hist07:50:011
1294519993631,4cyclictest1366135-21kworker/u8:0+flush-8:009:17:510
1294519993628,6cyclictest1509966-21latency_hist10:45:010
1294519993627,7cyclictest1575202-21/usr/sbin/munin11:52:590
1294527993526,7cyclictest1580130-21cp11:55:012
1294527993526,7cyclictest1371266-21cp08:25:012
1294522993531,2cyclictest1426602-21irqrtprio09:22:511
1294522993530,4cyclictest1595032-21kworker/u8:2+events_unbound12:13:011
1294522993528,5cyclictest1525102-21kworker/u8:0+flush-8:011:18:001
1294519993526,6cyclictest1594803-21latency_hist12:10:010
1294519993524,2cyclictest161rcu_preempt09:02:580
1294522993429,4cyclictest1460498-21kworker/u8:1+events_unbound10:47:511
1294522993428,5cyclictest1430621-21kworker/u8:4+flush-8:009:43:011
1294522993426,6cyclictest1609640-21latency_hist12:25:011
1294519993430,3cyclictest4130059-21kworker/u8:3+flush-8:007:33:050
1294519993429,3cyclictest1600759-21irqcore12:17:520
1294519993427,5cyclictest1560146-21apt-get11:37:470
1294522993329,3cyclictest1460498-21kworker/u8:1+events_unbound10:02:511
1294522993329,2cyclictest1337060-21cut07:52:501
1294522993328,4cyclictest1301707-21kworker/u8:1+flush-8:007:17:511
1294522993323,8cyclictest1424770-21ntpq09:18:021
1294522993226,5cyclictest1366135-21kworker/u8:0+flush-8:008:43:021
1294522993225,5cyclictest1294856-21/usr/sbin/munin07:13:041
1294522993224,6cyclictest1460498-21kworker/u8:1+flush-8:010:42:591
1294519993228,2cyclictest1385898-21turbostat.cron08:40:000
1294519993228,2cyclictest1385898-21turbostat.cron08:40:000
1294519993222,8cyclictest1455077-21latency_hist09:50:000
1294522993127,2cyclictest1453600-21kthreadcore09:47:561
1294522993126,4cyclictest1470179-21kworker/u8:2+events_unbound10:52:491
1294522993126,3cyclictest1331562-21kworker/u8:1+events_unbound08:08:021
1294522993116,3cyclictest0-21swapper/110:12:481
1294519993127,2cyclictest1584902-21idleruntime-cro12:00:010
1294519993126,3cyclictest1496243-21kworker/u8:3+events_unbound11:23:040
1294519993125,5cyclictest1460498-21kworker/u8:1+flush-8:010:33:050
1294519993125,4cyclictest1460498-21kworker/u8:1+events_unbound11:13:050
1294519993122,7cyclictest1380964-21latency_hist08:35:000
1294519993121,7cyclictest1475557-21/usr/sbin/munin10:13:000
1294527993025,3cyclictest1395342-21grep08:48:032
1294527993024,4cyclictest1327050-21cpuspeed_turbos07:42:502
1294522993026,3cyclictest1585152-21kworker/u8:1+flush-8:012:33:051
1294522993026,3cyclictest1585152-21kworker/u8:1+flush-8:012:33:051
1294522993025,4cyclictest1430621-21kworker/u8:4+flush-8:009:37:581
1294522993025,3cyclictest1366135-21kworker/u8:0+flush-8:008:47:491
1294522993025,3cyclictest0-21swapper/112:10:001
1294522993024,5cyclictest1496243-21kworker/u8:3+flush-8:012:03:011
1294522993023,5cyclictest1460498-21kworker/u8:1+flush-8:010:38:061
1294522993022,6cyclictest4130059-21kworker/u8:3+flush-8:008:57:591
1294519993024,4cyclictest1585152-21kworker/u8:1+events_unbound12:32:560
1294519993024,4cyclictest1585152-21kworker/u8:1+events_unbound12:32:560
1294527992925,2cyclictest1474863-21unixbench_multi10:08:062
1294527992924,3cyclictest1620524-21fschecks_count12:37:512
1294527992924,3cyclictest1620524-21fschecks_count12:37:512
1294527992923,4cyclictest1406205-21aten2_r5power_v09:02:472
1294522992924,4cyclictest1559911-21kworker/u8:2+flush-8:011:52:551
1294522992924,3cyclictest1460498-21kworker/u8:1+events_unbound10:32:591
1294522992923,5cyclictest1366135-21kworker/u8:0+flush-8:008:53:061
1294522992922,4cyclictest1316188-21unixbench_multi07:28:081
1294522992922,4cyclictest1316188-21unixbench_multi07:28:071
1294519992921,5cyclictest275-21systemd-journal11:05:220
1294527992824,2cyclictest1475642-21aten2_r5power_e10:12:492
1294522992823,3cyclictest1360938-21kworker/u8:2+events_unbound08:27:481
1294519992824,3cyclictest1373704-21kthreadcore08:27:550
1294519992823,4cyclictest1346146-21latency_hist08:00:010
1294519992822,3cyclictest0-21swapper/011:02:470
1294519992822,3cyclictest0-21swapper/011:02:470
1294519992818,8cyclictest1444457-21ntpq09:37:560
1294527992724,2cyclictest1555477-21fschecks_count11:32:512
1294522992722,3cyclictest0-21swapper/107:37:591
1294522992721,4cyclictest1600948-21irqrtprio12:17:531
1294519992722,3cyclictest1316189-21unixbench_multi07:28:070
1294519992722,3cyclictest1316189-21unixbench_multi07:28:070
1294519992721,4cyclictest4130059-21kworker/u8:3+flush-8:008:57:560
1294519992721,4cyclictest1299374-21apt-get07:15:020
1294527992622,2cyclictest1464959-21unixbench_multi09:58:082
1294527992622,2cyclictest1396259-21aten2_r5power_c08:52:482
1294527992621,3cyclictest1299373-21latency_hist07:15:002
1294522992623,2cyclictest1321371-21systemd-run07:35:001
1294522992621,1cyclictest161rcu_preempt11:32:541
1294522992620,4cyclictest4130059-21kworker/u8:3+events_unbound08:02:551
1294519992622,3cyclictest1460498-21kworker/u8:1+events_unbound10:38:050
1294519992622,2cyclictest0-21swapper/010:07:500
1294519992621,3cyclictest1294379-21kworker/u8:2+flush-8:007:43:070
1294519992620,4cyclictest1609631-21cron12:25:000
1294519992619,5cyclictest4130059-21kworker/u8:3+events_unbound08:02:510
1294519992617,6cyclictest1470162-21latency_hist10:05:010
1294527992522,2cyclictest1450720-21aten2_r5power_v09:47:482
1294527992522,2cyclictest1356767-21fschecks_time08:12:552
1294527992521,2cyclictest1615994-21kthreadcore12:32:542
1294527992521,2cyclictest1615994-21kthreadcore12:32:542
1294527992520,4cyclictest1539768-21apt-key11:15:012
1294522992522,1cyclictest0-21swapper/108:32:531
1294522992521,3cyclictest1460498-21kworker/u8:1+flush-8:011:13:071
129451999258,16cyclictest1525064-21kworker/0:3+events12:12:560
1294519992521,3cyclictest1326338-21turbostat.cron07:40:000
1294519992521,2cyclictest0-21swapper/008:55:000
1294519992520,3cyclictest1609907-21kworker/u8:0+flush-8:012:37:460
1294519992520,3cyclictest1609907-21kworker/u8:0+flush-8:012:37:460
1294519992519,4cyclictest1485159-21latency_hist10:20:010
1294519992519,4cyclictest1460498-21kworker/u8:1+events_unbound10:27:580
1294527992420,2cyclictest1600284-21aten2_r5power_e12:17:472
1294527992420,2cyclictest1570377-21aten2_r5power_p11:47:482
1294527992420,2cyclictest1505607-21aten2_r5power_v10:42:492
1294527992418,4cyclictest1530288-21aten2_r5power_c11:07:482
129452299248,4cyclictest0-21swapper/110:09:011
1294522992420,3cyclictest1559911-21kworker/u8:2+flush-8:011:43:061
1294522992420,3cyclictest1321576-21kworker/u8:0+events_unbound07:42:561
1294519992420,3cyclictest1460498-21kworker/u8:1+events_unbound10:00:000
1294519992420,2cyclictest1544869-21idleruntime-cro11:20:000
1294519992417,5cyclictest4130059-21kworker/u8:3+flush-8:007:53:000
1294527992319,2cyclictest1420939-21aten2_r5power_c09:17:482
1294527992319,2cyclictest1336769-21aten2_r5power_e07:52:482
1294522992318,4cyclictest1460498-21kworker/u8:1+flush-8:009:58:131
1294522992318,3cyclictest1460498-21kworker/u8:1+events_unbound11:04:251
1294522992318,3cyclictest1460498-21kworker/u8:1+events_unbound11:04:241
1294519992319,3cyclictest1410585-21kworker/u8:1+events_unbound09:12:510
1294519992319,2cyclictest0-21swapper/012:03:080
1294519992318,4cyclictest1390598-21unixbench_multi08:43:070
1294519992317,4cyclictest1460498-21kworker/u8:1+events_unbound10:52:590
1294519992317,4cyclictest0-21swapper/007:22:510
1294519992316,5cyclictest1445672-21munin-node09:42:470
1294519992313,3cyclictest421rcuog/211:47:560
12897272233,3sleep00-21swapper/007:05:380
1294527992218,3cyclictest1435306-21cron09:30:002
129452799221,5cyclictest1444472-21ntpq09:37:562
129452799221,11cyclictest1305820-21ntpq07:18:002
1294519992218,3cyclictest1614353-21unixbench_multi12:28:070
1294519992218,3cyclictest1426413-21sort09:22:510
1294519992218,2cyclictest0-21swapper/011:33:060
1294519992216,4cyclictest1369460-21kthreadcore08:22:580
1294519992216,3cyclictest0-21swapper/010:57:460
1294519992211,2cyclictest161rcu_preempt09:07:460
1294527992118,2cyclictest1411143-21aten2_r5power_v09:07:482
1294527992117,2cyclictest1610142-21aten2_r5power_c12:27:492
1294527992115,4cyclictest1584698-21unixbench_singl11:58:062
1294527992115,4cyclictest1326340-21sh07:40:002
1294527992115,4cyclictest0-21swapper/210:35:012
1294527992113,6cyclictest1375777-21unixbench_multi08:28:052
1294522992117,2cyclictest0-21swapper/107:58:031
129451999217,5cyclictest0-21swapper/007:45:290
1294519992117,3cyclictest1352229-21tr08:07:530
1294519992117,2cyclictest0-21swapper/010:48:000
1294519992116,3cyclictest1430907-21aten2_r5power_p09:27:480
14907372200,6chrt0-21swapper/210:27:502
1294527992016,2cyclictest1426149-21fschecks_count09:22:482
1294527992016,2cyclictest1401385-21cpuspeed_turbos08:57:492
1294527992015,3cyclictest0-21swapper/210:23:082
1294519992016,2cyclictest0-21swapper/008:17:540
12936642204,9sleep30-21swapper/307:08:023
129452799199,7cyclictest1524485-21grep10:58:052
129452799192,12cyclictest1585377-21apt-get12:02:512
1294527991915,2cyclictest0-21swapper/211:02:572
1294527991915,2cyclictest0-21swapper/211:02:572
1294527991915,2cyclictest0-21swapper/208:43:062
1294527991914,4cyclictest1564625-21sendmail11:40:002
1294527991914,3cyclictest1569820-21cron11:45:002
1294527991911,6cyclictest0-21swapper/207:27:562
1294527991911,6cyclictest0-21swapper/207:27:562
1294519991914,4cyclictest1489681-21unixbench_multi10:23:080
129452799187,8cyclictest1591537-21cut12:07:542
129452799187,8cyclictest0-21swapper/212:10:422
129452799183,10cyclictest1346580-21apt-get08:02:482
129452799182,10cyclictest1306980-21apt-get07:22:482
1294527991815,2cyclictest0-21swapper/207:33:022
1294527991814,3cyclictest1346103-21sendmail08:00:002
1294527991814,2cyclictest0-21swapper/211:27:582
1294527991810,6cyclictest1519816-21cron10:55:002
129452799179,6cyclictest1363176-21tr08:17:562
129452799178,7cyclictest1377255-21sed08:32:542
1294527991713,2cyclictest0-21swapper/207:48:002
1294527991712,3cyclictest0-21swapper/210:37:562
1294527991711,4cyclictest0-21swapper/209:42:562
129452799171,11cyclictest1465688-21apt-get10:02:482
1294527991610,4cyclictest0-21swapper/208:37:572
1294527991610,4cyclictest0-21swapper/208:37:572
129452799156,7cyclictest0-21swapper/209:32:332
129452799154,8cyclictest0-21swapper/208:05:062
14854802143,7sleep30-21swapper/310:22:503
13564252142,8sleep30-21swapper/308:12:503
16091112132,7sleep30-21swapper/312:23:073
15707482133,6sleep30-21swapper/311:47:533
14656922132,7sleep30-21swapper/310:02:483
14604912132,7sleep30-21swapper/309:55:023
16149522122,6sleep30-21swapper/312:31:393
16149522122,6sleep30-21swapper/312:31:383
15997752122,5sleep30-21swapper/312:15:013
15956422122,6sleep30-21swapper/312:12:523
15940482122,6sleep30-21swapper/312:07:593
15896502122,6sleep30-21swapper/312:03:093
15747662122,5sleep30-21swapper/311:50:013
15648652122,5sleep30-21swapper/311:40:023
15600822122,6sleep30-21swapper/311:37:213
15554972122,6sleep30-21swapper/311:32:523
15498252122,6sleep30-21swapper/311:25:013
15389442122,6sleep30-21swapper/311:13:023
15153412123,6sleep30-21swapper/310:52:493
14953282122,6sleep30-21swapper/310:32:493
14826722123,6sleep30-21swapper/310:17:573
14740632122,6sleep30-21swapper/310:07:583
14572782122,6sleep30-21swapper/309:52:573
14506102122,6sleep30-21swapper/309:47:483
14452572122,5sleep30-21swapper/309:40:013
14356032123,6sleep30-21swapper/309:30:503
14313332123,6sleep30-21swapper/309:27:533
14204662122,6sleep30-21swapper/309:15:023
14202162122,6sleep30-21swapper/309:13:053
14147812123,5sleep30-21swapper/309:07:593
14097472122,6sleep30-21swapper/309:02:583
14011652122,6sleep30-21swapper/308:57:483
13814462122,6sleep30-21swapper/308:37:503
13814462122,6sleep30-21swapper/308:37:503
13764952125,4sleep30-21swapper/308:32:493
13617602122,6sleep30-21swapper/308:17:523
13425272122,6sleep30-21swapper/307:57:543
13313392122,6sleep30-21swapper/307:45:023
13223462122,6sleep30-21swapper/307:37:563
13110812122,6sleep30-21swapper/307:23:073
13058342122,6sleep30-21swapper/307:18:023
12947772122,6sleep30-21swapper/307:11:483
16201552112,6sleep30-21swapper/312:36:483
16201552112,6sleep30-21swapper/312:36:483
15803982113,5sleep30-21swapper/311:57:483
15452042112,6sleep30-21swapper/311:21:243
15407332112,5sleep30-21swapper/311:17:513
15301732112,6sleep30-21swapper/311:07:043
15249882112,5sleep30-21swapper/311:00:033
15249882112,5sleep30-21swapper/311:00:023
15202452112,5sleep30-21swapper/310:57:453
15102532112,6sleep30-21swapper/310:45:533
15052752113,5sleep30-21swapper/310:40:203
15002742112,5sleep30-21swapper/310:35:023
14902512112,5sleep30-21swapper/310:26:233
14758192112,5sleep30-21swapper/310:12:513
14257862112,6sleep30-21swapper/309:21:523
13957902111,6sleep30-21swapper/308:50:023
13862982112,6sleep30-21swapper/308:42:033
13718412112,5sleep30-21swapper/308:27:513
13663692112,6sleep30-21swapper/308:22:493
13553092112,5sleep30-21swapper/308:08:013
13465522112,5sleep30-21swapper/308:02:473
13366122113,5sleep30-21swapper/307:51:523
13268242112,5sleep30-21swapper/307:42:493
13164942112,5sleep30-21swapper/307:30:023
13118192112,6sleep30-21swapper/307:26:363
13118192112,6sleep30-21swapper/307:26:363
14405032102,5sleep30-21swapper/309:35:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional