You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-28 - 02:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Sep 28, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
148347721880,2sleep3471rcuc/320:55:003
148347721880,2sleep3471rcuc/320:55:003
15223872840,3sleep01522391-21latency21:34:020
15041292750,4chrt0-21swapper/121:18:581
1377207997062,6cyclictest1685967-21kworker/u8:2+events_unbound00:23:581
1377207996152,7cyclictest1403835-21latency_hist19:35:011
1377207996151,7cyclictest278-21systemd-journal21:03:571
1377207996055,4cyclictest1398880-21kworker/u8:0+flush-8:019:58:571
1377207995950,6cyclictest278-21systemd-journal21:33:571
14332972580,2chrt75-21kworker/3:1-events20:04:123
1377207995850,6cyclictest1483188-21latency_hist20:55:001
1377207995850,6cyclictest1483188-21latency_hist20:55:001
1377207995649,5cyclictest1021763-21kworker/u8:2+flush-8:020:33:561
1377207995645,9cyclictest278-21systemd-journal20:10:571
1377208995447,4cyclictest1632995-21kworker/u8:0+flush-8:023:29:052
1377207995348,4cyclictest1577931-21kworker/u8:0+events_unbound22:34:041
1377207995345,4cyclictest1398880-21kworker/u8:0+flush-8:019:38:581
16263042520,3sleep375-21kworker/3:1+events23:19:033
15663882520,3sleep375-21kworker/3:1-mm_percpu_wq22:18:593
1377208995243,7cyclictest1513191-21cp21:25:012
1377207995143,6cyclictest1398852-21latency_hist19:30:011
16085332500,3chrt75-21kworker/3:1+events23:00:013
1377207995042,6cyclictest278-21systemd-journal22:16:571
1377207994942,5cyclictest278-21systemd-journal20:18:571
1377203994641,4cyclictest1665817-21kworker/u8:3+events_unbound00:09:000
1377203994640,4cyclictest1393802-21kworker/u8:3+flush-8:019:29:050
1377203994638,6cyclictest1443597-21latency_hist20:15:010
1377203994636,8cyclictest1552696-21ntpq22:04:060
1377207994534,8cyclictest278-21systemd-journal19:53:571
1377203994538,5cyclictest8907-21kworker/u8:1+flush-8:019:19:100
1377203994536,6cyclictest1413722-21latency_hist19:45:010
16526122440,2chrt0-21swapper/023:44:120
1377208994435,6cyclictest1558566-21cat22:10:012
1377207994439,3cyclictest1618128-21kworker/u8:2+events_unbound23:54:121
1377203994436,6cyclictest278-21systemd-journal23:16:570
1377207994334,6cyclictest1478182-21latency_hist20:50:001
1377207994334,6cyclictest1478182-21latency_hist20:50:001
1377208994237,3cyclictest1340928-21kworker/u8:0+flush-8:019:14:062
1377207994235,5cyclictest1553360-21kworker/u8:1+flush-8:023:24:051
1377207994234,5cyclictest278-21systemd-journal20:58:571
1377203994235,5cyclictest1393802-21kworker/u8:3+flush-8:020:09:080
1377207994136,3cyclictest1632995-21kworker/u8:0+flush-8:000:00:021
1377207994135,5cyclictest1021763-21kworker/u8:2+events_unbound21:24:041
1377207994134,6cyclictest1618128-21kworker/u8:2+flush-8:023:58:581
1377207994133,6cyclictest1433527-21latency_hist20:05:011
1377203994137,3cyclictest1538293-21kworker/u8:0+events_unbound21:53:540
1377203994136,4cyclictest1632995-21kworker/u8:0+events_unbound00:00:010
1377203994132,7cyclictest1488354-21latency_hist21:00:000
1377207994035,4cyclictest1340928-21kworker/u8:0+events_unbound19:13:551
1377203994033,5cyclictest278-21systemd-journal22:45:000
1377207993930,7cyclictest1543223-21latency_hist21:55:011
1377203993934,4cyclictest1398880-21kworker/u8:0+events_unbound20:20:010
1377203993934,4cyclictest1021763-21kworker/u8:2+events_unbound21:14:040
1377208993832,4cyclictest278-21systemd-journal22:05:002
1377207993833,4cyclictest1398880-21kworker/u8:0+flush-8:019:43:551
1377207993832,4cyclictest1398880-21kworker/u8:0+flush-8:020:29:061
1377207993832,4cyclictest1021763-21kworker/u8:2+flush-8:022:44:111
1377207993830,6cyclictest1414267-21apt-get19:48:521
1377207993829,7cyclictest1449097-21apt-get20:23:511
1377203993834,3cyclictest1398880-21kworker/u8:0+flush-8:020:03:570
1377203993832,4cyclictest1553360-21kworker/u8:1+events_unbound22:28:540
1377208993731,4cyclictest1340928-21kworker/u8:0+flush-8:019:15:022
1377207993732,4cyclictest1598318-21kworker/u8:3+events_unbound23:19:001
1377207993732,4cyclictest1577931-21kworker/u8:0+flush-8:022:59:091
1377207993731,4cyclictest1665817-21kworker/u8:3+events_unbound00:33:521
1377203993732,4cyclictest1398880-21kworker/u8:0+flush-8:020:24:080
13770322372,15sleep01377056-21munin-run19:10:000
1377208993623,5cyclictest1598318-21kworker/u8:3+events_unbound23:34:092
1377207993631,4cyclictest1021763-21kworker/u8:2+events_unbound22:14:111
1377207993629,5cyclictest278-21systemd-journal22:48:561
1377203993632,3cyclictest1398880-21kworker/u8:0+events_unbound19:38:580
1377203993631,4cyclictest1021763-21kworker/u8:2+flush-8:021:39:120
1377208993530,4cyclictest1398880-21kworker/u8:0+events_unbound19:54:062
1377207993531,3cyclictest8907-21kworker/u8:1+flush-8:019:18:561
1377207993530,3cyclictest1685967-21kworker/u8:2+events_unbound00:29:091
1377207993529,5cyclictest1518191-21kworker/u8:1+events_unbound21:48:551
1377207993529,5cyclictest1508153-21kworker/u8:3+events_unbound22:00:021
1377207993529,4cyclictest1683343-21apt-get00:18:491
1377203993525,7cyclictest1463382-21latency_hist20:35:010
1377208993430,3cyclictest1577931-21kworker/u8:0+flush-8:022:49:062
1377207993430,3cyclictest1021763-21kworker/u8:2+events_unbound21:38:571
1377207993428,4cyclictest1618128-21kworker/u8:2+flush-8:023:39:011
1377207993427,6cyclictest1577931-21kworker/u8:0+flush-8:022:39:071
1377203993430,3cyclictest390-21dbus-daemon21:20:010
1377203993429,3cyclictest1459355-21kworker/u8:1+events_unbound20:38:560
1377203993428,4cyclictest1553360-21kworker/u8:1+events_unbound22:55:010
1377203993424,7cyclictest1608294-21latency_hist23:00:000
1377208993329,3cyclictest1021763-21kworker/u8:2+events_unbound21:59:032
1377208993327,4cyclictest1577931-21kworker/u8:0+events_unbound22:29:062
1377208993325,6cyclictest278-21systemd-journal21:18:572
1377207993329,3cyclictest1632995-21kworker/u8:0+flush-8:023:49:111
1377207993329,3cyclictest1577931-21kworker/u8:0+flush-8:022:29:091
1377207993327,4cyclictest278-21systemd-journal20:08:571
1377207993326,5cyclictest1478683-21kworker/u8:3+flush-8:021:08:571
1377207993326,4cyclictest1553360-21kworker/u8:1+flush-8:022:24:051
1377207993321,9cyclictest278-21systemd-journal22:55:001
1377203993327,4cyclictest1518191-21kworker/u8:1+events_unbound21:49:110
1377203993327,4cyclictest1483015-21grep20:54:100
1377203993327,4cyclictest1483015-21grep20:54:100
1377203993327,4cyclictest1398880-21kworker/u8:0+events_unbound20:00:000
1377208993228,3cyclictest1685967-21kworker/u8:2+events_unbound00:39:102
1377208993227,3cyclictest1665817-21kworker/u8:3+events_unbound00:18:592
1377208993227,3cyclictest1533107-21apt-get21:45:032
1377208993225,5cyclictest1632995-21kworker/u8:0+events_unbound00:14:052
1377207993228,3cyclictest1398880-21kworker/u8:0+flush-8:020:43:561
1377207993227,3cyclictest1558280-21apt-get22:10:001
1377207993222,7cyclictest278-21systemd-journal21:43:571
1377203993225,5cyclictest278-21systemd-journal20:45:370
1377203993225,5cyclictest278-21systemd-journal20:45:370
13725042324,9sleep20-21swapper/219:06:252
1377208993126,3cyclictest1398880-21kworker/u8:0+events_unbound20:30:012
1377208993120,9cyclictest1503214-21awk21:15:002
1377207993125,5cyclictest1021763-21kworker/u8:2+flush-8:021:29:071
1377207993125,4cyclictest1503200-21latency_hist21:15:011
1377207993122,7cyclictest1678407-21apt-get00:13:511
1377207993121,8cyclictest1623140-21turbostat.cron23:15:011
137720799311,12cyclictest16114242kthreadcore23:04:021
137720799311,12cyclictest16114242kthreadcore23:04:021
1377203993127,3cyclictest1684070-21irqrtprio00:18:570
1377203993126,4cyclictest1553360-21kworker/u8:1+flush-8:022:24:080
1377203993125,5cyclictest1021763-21kworker/u8:2+flush-8:022:34:060
1377203993125,4cyclictest1577931-21kworker/u8:0+flush-8:022:39:100
137720399312,25cyclictest1613261-21kworker/0:1+events23:26:430
1377208993022,6cyclictest278-21systemd-journal22:14:572
1377207993026,3cyclictest1677887-21systemd-run00:10:001
1377207993022,6cyclictest1463926-21apt-get20:38:511
1377203993025,4cyclictest1021763-21kworker/u8:2+events_unbound21:58:590
1377203993024,4cyclictest1685967-21kworker/u8:2+flush-8:000:39:050
1377203993024,4cyclictest1598247-21unixbench_multi22:49:120
1377208992924,4cyclictest8907-21kworker/u8:1+events_unbound19:24:142
1377208992924,3cyclictest1489131-21cpuspeed_turbos21:03:532
1377208992922,5cyclictest1685967-21kworker/u8:2+flush-8:000:34:022
1377207992925,3cyclictest1632995-21kworker/u8:0+flush-8:023:28:551
1377207992925,3cyclictest1340928-21kworker/u8:0+events_unbound19:23:581
1377203992924,4cyclictest1598318-21kworker/u8:3+flush-8:023:34:100
1377203992924,4cyclictest1422909-21needreboot19:54:030
1377203992924,4cyclictest1398880-21kworker/u8:0+events_unbound21:05:010
1377203992923,5cyclictest1685967-21kworker/u8:2+events_unbound00:23:530
1377203992923,5cyclictest1398880-21kworker/u8:0+flush-8:021:07:280
1377203992923,4cyclictest1665817-21kworker/u8:3+events_unbound00:30:000
1377208992824,3cyclictest1021763-21kworker/u8:2+events_unbound21:29:142
1377208992818,7cyclictest1478181-21cat20:50:002
1377208992818,7cyclictest1478181-21cat20:50:002
1377207992824,3cyclictest1544483-21irqrtprio21:58:581
1377207992822,4cyclictest1685967-21kworker/u8:2+flush-8:000:39:071
1377203992824,3cyclictest1632995-21kworker/u8:0+events_unbound23:40:010
1377203992823,3cyclictest1398880-21kworker/u8:0+events_unbound20:29:110
1377203992821,5cyclictest1700361-21kthreadcore00:33:590
1377203992820,6cyclictest1513845-21/usr/sbin/munin21:29:040
1377203992818,8cyclictest1553360-21kworker/u8:1+flush-8:023:24:020
1377208992723,3cyclictest1528026-21unixbench_singl21:39:122
1377208992722,3cyclictest1484185-21cpuspeed_turbos20:58:562
1377203992723,3cyclictest1021763-21kworker/u8:2+flush-8:021:24:090
1377203992722,4cyclictest1021763-21kworker/u8:2+events_unbound22:13:570
1377203992722,3cyclictest1632995-21kworker/u8:0+flush-8:000:05:000
1377203992721,4cyclictest1632995-21kworker/u8:0+events_unbound23:49:060
137720399271,25cyclictest1613261-21kworker/0:1+events23:14:470
1377208992623,2cyclictest1609208-21fschecks_time23:03:572
1377208992623,2cyclictest1609208-21fschecks_time23:03:572
1377208992622,2cyclictest1414326-21aten2_r5power_e19:48:552
1377208992620,4cyclictest1553360-21kworker/u8:1+events_unbound22:40:022
1377203992623,2cyclictest1533107-21apt-get21:45:010
1377203992622,3cyclictest1021763-21kworker/u8:2+flush-8:022:09:020
1377203992620,4cyclictest1656061-21kworker/u8:1+flush-8:023:53:570
1377203992616,8cyclictest1414558-21fschecks_count19:48:560
1377208992520,3cyclictest1519094-21fschecks_count21:33:552
1377207992520,3cyclictest1598318-21kworker/u8:3+flush-8:023:30:311
137720399253,17cyclictest1372194-21kworker/0:0+events19:30:110
1377203992521,3cyclictest1632995-21kworker/u8:0+events_unbound00:14:590
1377203992519,5cyclictest1398880-21kworker/u8:0+flush-8:020:44:060
15835392240,3sleep375-21kworker/3:1-events22:35:013
1377208992420,2cyclictest1673764-21fschecks_count00:08:552
1377208992419,4cyclictest1665817-21kworker/u8:3+events_unbound23:59:112
1377208992419,4cyclictest1398880-21kworker/u8:0+flush-8:020:30:022
1377208992419,3cyclictest390-21dbus-daemon20:10:002
1377208992419,3cyclictest1483203-21apt-get20:55:002
1377208992419,3cyclictest1483203-21apt-get20:55:002
1377208992419,3cyclictest1444370-21cpuspeed_turbos20:18:552
1377207992419,4cyclictest1577931-21kworker/u8:0+events_unbound23:08:551
137720399245,18cyclictest1568664-21kworker/0:0+events23:02:190
137720399245,18cyclictest1568664-21kworker/0:0+events23:02:190
1377203992420,3cyclictest1382076-21latency_hist19:15:010
1377203992419,4cyclictest1618016-21unixbench_multi23:09:120
1377203992414,8cyclictest1389769-21fschecks_count19:23:550
137720899232,15cyclictest1653429-21apt-get23:48:552
1377208992314,6cyclictest278-21systemd-journal19:45:002
1377208992313,7cyclictest1623053-21users23:14:112
1377203992319,3cyclictest1021763-21kworker/u8:2+events_unbound22:19:040
1377208992218,2cyclictest1579139-21aten2_r5power_p22:33:532
1377208992217,4cyclictest1553360-21kworker/u8:1+events_unbound23:06:042
1377207992218,2cyclictest0-21swapper/123:43:571
14087682210,4sleep3481ktimers/319:40:003
137720899212,13cyclictest1429112-21apt-get20:03:542
1377208992117,2cyclictest0-21swapper/223:54:052
1377208992117,2cyclictest0-21swapper/223:40:002
1377208992117,2cyclictest0-21swapper/222:59:012
1377208992117,2cyclictest0-21swapper/221:45:002
13726522214,11sleep10-21swapper/119:08:211
137720899207,4cyclictest0-21swapper/219:28:532
1377208992017,2cyclictest1672221-21needreboot00:04:022
1377208992017,2cyclictest1633064-21idleruntime-cro23:25:002
1377208992016,2cyclictest1648693-21cpuspeed_turbos23:43:552
137720899200,10cyclictest1498119-21grep21:09:132
1377208991916,2cyclictest0-21swapper/222:20:012
137720899191,13cyclictest1399397-21apt-get19:33:532
13729602193,9sleep30-21swapper/319:08:553
1377208991815,2cyclictest1697645-21idleruntime-cro00:30:002
1377208991814,2cyclictest0-21swapper/220:43:592
1377208991810,6cyclictest278-21systemd-journal20:15:002
1377208991810,6cyclictest1424757-21sed19:58:592
137720899179,6cyclictest1690009-21cut00:23:592
137720899177,7cyclictest1463929-21seq20:38:522
1377208991713,2cyclictest1570606-21kthreadcore22:24:002
1377208991713,2cyclictest0-21swapper/223:19:102
1377208991713,2cyclictest0-21swapper/222:53:592
1377208991711,4cyclictest0-21swapper/219:39:032
16182032160,2sleep3471rcuc/323:10:003
1377208991613,2cyclictest0-21swapper/221:53:162
1377208991613,2cyclictest0-21swapper/220:20:162
1377208991612,2cyclictest0-21swapper/222:38:572
16114192150,3sleep375-21kworker/3:1-events23:04:023
16114192150,3sleep375-21kworker/3:1-events23:04:023
16922072133,6sleep30-21swapper/300:24:093
16778502132,7sleep30-21swapper/300:10:003
16657662133,6sleep30-21swapper/323:59:013
15091752132,7sleep30-21swapper/321:23:593
14834772133,5sleep30-21swapper/320:55:013
14773852132,7sleep30-21swapper/320:49:033
14773852132,7sleep30-21swapper/320:49:033
13938572130,10sleep30-21swapper/319:25:003
16927322122,6sleep30-21swapper/300:25:013
16876502122,6sleep30-21swapper/300:19:113
16587072122,6sleep30-21swapper/323:53:553
16489612122,6sleep30-21swapper/323:44:003
16385352122,6sleep30-21swapper/323:33:523
16377702122,6sleep30-21swapper/323:29:113
16182032122,6sleep30-21swapper/323:10:013
15953702122,6sleep30-21swapper/322:49:023
15590562122,6sleep30-21swapper/322:13:553
15537872122,6sleep30-21swapper/322:07:573
15494522122,6sleep30-21swapper/322:04:003
15442592122,6sleep30-21swapper/321:58:583
15287192122,6sleep30-21swapper/321:43:533
15192442123,5sleep30-21swapper/321:33:583
15178822121,7sleep30-21swapper/321:29:123
15043352120,8sleep30-21swapper/321:19:013
14681462122,6sleep30-21swapper/320:39:123
14584252122,6sleep30-21swapper/320:30:013
14539132122,6sleep30-21swapper/320:27:573
14335492122,6sleep30-21swapper/320:05:013
14087682122,6sleep30-21swapper/319:40:013
13996392122,6sleep30-21swapper/319:33:553
17029062112,6sleep30-21swapper/300:36:003
16782282112,6sleep30-21swapper/300:11:533
16681822112,6sleep30-21swapper/300:00:093
16572622112,6sleep30-21swapper/323:49:093
16284742113,5sleep30-21swapper/323:22:013
15987332112,5sleep30-21swapper/322:51:393
15887902113,5sleep30-21swapper/322:40:593
15840982112,6sleep30-21swapper/322:38:553
15739682112,6sleep30-21swapper/322:26:553
15690142112,6sleep30-21swapper/322:21:573
15331372110,6sleep30-21swapper/321:45:013
15237362112,5sleep30-21swapper/321:38:513
14985972112,6sleep30-21swapper/321:11:433
14936832113,5sleep30-21swapper/321:07:013
14892832112,5sleep30-21swapper/321:03:563
14687602112,6sleep30-21swapper/320:42:583
14490362112,6sleep30-21swapper/320:23:233
14440502112,6sleep30-21swapper/320:17:573
14391822112,5sleep30-21swapper/320:13:523
14241002112,6sleep30-21swapper/319:58:273
14191482112,6sleep30-21swapper/319:53:133
14140222112,6sleep30-21swapper/319:45:593
13941312112,6sleep30-21swapper/319:25:283
13830372112,6sleep30-21swapper/319:15:053
13814822112,6sleep30-21swapper/319:14:093
16978842102,5sleep30-21swapper/300:30:113
16431802102,5sleep30-21swapper/323:35:093
15384972102,5sleep30-21swapper/321:50:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional