You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 12:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat May 09, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
131426421900,2sleep375-21kworker/3:1+events20:31:033
138019121800,5sleep30-21swapper/321:36:043
14858332800,2sleep3471rcuc/323:21:133
1231973997556,17cyclictest1561238-21apt-get00:40:001
1231973997362,8cyclictest1263525-21latency_hist19:40:011
1231973996442,20cyclictest1353071-21apt-get21:10:531
1231977996051,7cyclictest1342733-21gpgv21:00:012
1231973995648,5cyclictest280-21systemd-journal23:40:561
1231973995549,4cyclictest1372208-21kworker/u8:0+events_unbound21:56:061
1231973995536,6cyclictest1451785-21latency_hist22:50:001
13904412540,3chrt75-21kworker/3:1-events21:46:023
1231977995446,6cyclictest1501515-21cp23:40:002
13594872530,1sleep01359491-21grep21:16:020
1231973995337,4cyclictest1328132-21apt-get20:45:541
13697622500,3chrt0-21swapper/021:26:020
1231973995041,6cyclictest1412269-21latency_hist22:10:011
1231968995043,5cyclictest1417513-21apt-get22:15:530
1231973994927,9cyclictest1496209-21apt-get23:35:001
1231968994940,7cyclictest280-21systemd-journal20:40:000
1231973994639,5cyclictest1273726-21apt-get19:50:551
1231973994636,8cyclictest1511565-21apt-get23:50:001
1231973994636,7cyclictest280-21systemd-journal20:26:561
1231973994636,7cyclictest1476452-21latency_hist23:15:011
1231968994627,15cyclictest1521695-21latency_hist00:00:010
1231968994534,8cyclictest1510686-21ntpq23:46:070
1231968994533,9cyclictest280-21systemd-journal20:05:010
1231973994437,5cyclictest1541822-21apt-get00:20:551
1231968994436,6cyclictest1317046-21ntpq20:31:070
1231968994432,9cyclictest1277431-21ntpq19:51:080
1231977994333,8cyclictest1496373-21cat23:35:002
1231968994331,9cyclictest1297296-21ntpq20:11:090
1231968994327,14cyclictest1486363-21systemd-run23:25:000
123196899431,26cyclictest1561311-21munin-run00:40:000
1231977994232,7cyclictest1511881-21cat23:50:012
1231973994235,5cyclictest280-21systemd-journal00:09:051
1231973994233,7cyclictest280-21systemd-journal20:15:001
1231968994233,6cyclictest1556285-21latency_hist00:35:010
1231968994224,16cyclictest1501412-21munin-run23:40:000
1231968994223,17cyclictest1342607-21apt-get21:00:000
1231968994214,17cyclictest0-21swapper/021:35:560
1231973994132,6cyclictest1481413-21latency_hist23:20:011
1231973994132,6cyclictest1317933-21latency_hist20:35:011
1231968994130,9cyclictest1437506-21diskstats22:35:590
1231968994115,22cyclictest0-21swapper/021:50:540
1231977994030,7cyclictest1372863-21cat21:30:002
1231973994033,5cyclictest1551685-21apt-get00:30:541
1231973994030,8cyclictest280-21systemd-journal21:20:011
1231973994029,8cyclictest280-21systemd-journal20:02:551
1231968993929,7cyclictest280-21systemd-journal19:56:570
1231968993923,14cyclictest1376758-21needreboot21:31:060
1231968993922,15cyclictest0-21swapper/023:34:590
1231968993919,18cyclictest1247795-21ntpq19:21:050
1231977993831,5cyclictest280-21systemd-journal21:10:002
1231977993828,8cyclictest1561254-21awk00:40:002
1231973993833,3cyclictest1372208-21kworker/u8:0+flush-8:022:11:131
1231973993832,4cyclictest390308-21kworker/u8:4+events_unbound21:31:131
1231973993830,4cyclictest0-21swapper/123:35:551
1231968993830,6cyclictest280-21systemd-journal20:53:040
1231968993829,7cyclictest1348364-21diskstats21:05:590
1231968993811,19cyclictest1427092-21kworker/0:2+events22:30:550
1231973993731,4cyclictest390308-21kworker/u8:4+flush-8:020:06:131
1231973993728,6cyclictest1303105-21latency_hist20:20:001
1231973993727,8cyclictest1343177-21apt-get21:00:541
123196899378,8cyclictest1343152-21munin-node21:00:540
1231968993719,16cyclictest0-21swapper/021:11:030
1231973993631,3cyclictest1427383-21apt-get22:25:541
1231973993626,8cyclictest1540599-21ntpq00:16:061
123197399361,31cyclictest1-21systemd21:25:001
1231968993630,4cyclictest280-21systemd-journal19:25:550
1231968993617,17cyclictest1526374-21unixbench_singl00:01:140
1231968993616,18cyclictest280-21systemd-journal20:30:000
1231973993529,4cyclictest390308-21kworker/u8:4+flush-8:021:40:011
1231973993529,4cyclictest1551033-21grep00:26:151
1231973993527,6cyclictest1466921-21apt-get23:05:551
1231973993527,6cyclictest1367893-21apt-get21:25:521
1231973993527,5cyclictest280-21systemd-journal22:20:561
123196899359,4cyclictest0-21swapper/020:17:430
1231968993530,3cyclictest1551368-21idleruntime-cro00:30:000
1231968993524,8cyclictest1475559-21ntpq23:11:070
1231968993518,15cyclictest0-21swapper/021:40:560
1231968993517,16cyclictest0-21swapper/019:15:020
1231968993511,6cyclictest1258573-21latency_hist19:35:010
1231973993430,3cyclictest1236951-21kworker/u8:1+flush-8:019:46:121
1231973993430,2cyclictest1348833-21irqrtprio21:06:021
1231973993422,9cyclictest280-21systemd-journal19:40:561
123196899349,4cyclictest1534840-21tr00:11:060
1231968993424,7cyclictest1303690-21diskstats20:20:570
1231968993415,17cyclictest0-21swapper/000:15:570
1231968993412,3cyclictest0-21swapper/000:09:040
13058682330,5sleep30-21swapper/320:21:043
1231977993324,7cyclictest1337680-21awk20:55:002
1231973993326,5cyclictest280-21systemd-journal22:20:001
1231973993326,5cyclictest280-21systemd-journal21:45:011
1231973993326,5cyclictest1520794-21ntpq23:56:071
1231968993327,4cyclictest1505703-21ntpq23:41:060
1231968993316,15cyclictest0-21swapper/023:16:030
1231968993314,2cyclictest0-21swapper/019:46:040
1231973993227,3cyclictest1395011-21kthreadcore21:51:031
1231973993226,4cyclictest402814-21kworker/u8:0+flush-8:019:16:111
1231973993226,4cyclictest390308-21kworker/u8:4+events_unbound19:11:031
1231973993226,3cyclictest1343033-21latency_hist21:00:011
1231973993223,7cyclictest1461962-21apt-get23:00:541
123196899328,6cyclictest1402817-21cut22:00:560
123196899325,6cyclictest589-21runrttasks23:00:550
123196899325,4cyclictest0-21swapper/022:05:170
1231968993218,12cyclictest0-21swapper/022:26:040
1231968993214,16cyclictest0-21swapper/023:06:000
1231968993214,16cyclictest0-21swapper/000:21:110
1231973993127,2cyclictest1446531-21unixbench_singl22:41:151
1231973993124,5cyclictest1481742-21apt-get23:20:541
1231973993124,5cyclictest1322868-21latency_hist20:40:011
123196899311,9cyclictest1412833-21diskstats22:10:580
123196899311,9cyclictest1388190-21diskstats21:45:570
1231968993115,14cyclictest0-21swapper/020:46:020
1231968993114,15cyclictest0-21swapper/022:40:560
1231968993112,2cyclictest0-21swapper/022:20:550
1231968993111,2cyclictest0-21swapper/023:51:010
1231968993110,7cyclictest1490494-21ntpq23:26:090
1231977993021,7cyclictest1417213-21awk22:15:002
1231973993021,7cyclictest280-21systemd-journal22:33:561
123196899308,6cyclictest1402520-21date22:00:010
123196899304,2cyclictest1455121-21kthreadcore22:51:040
123196899302,26cyclictest1199928-21kworker/0:1+events19:40:580
1231968993014,14cyclictest0-21swapper/021:21:040
1231968993011,4cyclictest141ktimers/019:10:550
1231968993011,2cyclictest0-21swapper/022:46:100
1231968993010,2cyclictest0-21swapper/020:05:590
123196899300,8cyclictest1259338-21/usr/sbin/munin19:36:010
1231973992923,4cyclictest1516636-21journal-offline23:53:381
1231973992918,8cyclictest390308-21kworker/u8:4+flush-8:019:21:061
123196899298,2cyclictest0-21swapper/020:41:030
123196899291,9cyclictest1231962-21cyclictest19:10:010
1231968992910,3cyclictest0-21swapper/022:56:130
1231973992823,3cyclictest280-21systemd-journal23:25:561
1231973992823,3cyclictest1437848-21irqcore22:36:021
1231973992823,3cyclictest1253636-21munin-run19:30:011
1231977992724,2cyclictest1387998-21aten2_r5power_e21:45:552
1231977992723,2cyclictest1546117-21grep00:21:162
1231973992722,3cyclictest1460670-21needreboot22:56:051
1231973992721,5cyclictest1236951-21kworker/u8:1+flush-8:019:56:001
1231973992721,4cyclictest1407323-21cron22:05:001
1231977992622,3cyclictest1383204-21cpuspeed_turbos21:40:552
1231977992620,4cyclictest1402055-21unixbench_singl21:56:142
1231977992617,2cyclictest161rcu_preempt00:32:312
1231973992620,4cyclictest1452097-21apt-get22:50:541
1231973992619,4cyclictest0-21swapper/121:46:011
1231973992618,6cyclictest1283292-21kworker/u8:2+flush-8:020:41:091
123197799254,8cyclictest0-21swapper/222:26:032
123197799253,12cyclictest1267682-21ntpq19:41:092
1231977992522,2cyclictest1277932-21unixbench_multi19:51:152
1231977992521,2cyclictest1517308-21tr23:55:582
1231977992521,2cyclictest1322520-21unixbench_singl20:36:142
1231977992521,2cyclictest1232528-21fschecks_time19:10:582
1231977992421,2cyclictest1527373-21sort00:05:592
1231977992420,2cyclictest1481855-21aten2_r5power_v23:20:552
1231977992420,2cyclictest1239300-21cpuspeed_turbos19:15:572
1231977992418,4cyclictest1436933-21cron22:34:592
123197799240,10cyclictest1502386-21awk23:40:592
1231973992418,4cyclictest1436894-21kworker/u8:2+flush-8:000:01:021
123197799236,8cyclictest0-21swapper/221:51:012
123197799232,20cyclictest0-21swapper/200:26:122
1231977992319,2cyclictest1462314-21fschecks_time23:00:592
123197799231,11cyclictest1317066-21ntpq20:31:082
123197799230,11cyclictest1477198-21awk23:16:002
1231973992319,2cyclictest0-21swapper/120:20:581
1231973992319,2cyclictest0-21swapper/119:31:021
123197799229,2cyclictest161rcu_preempt20:11:002
123197799226,5cyclictest0-21swapper/222:55:562
1231977992217,4cyclictest1536194-21unixbench_singl00:11:152
1231977992217,3cyclictest1312592-21unixbench_multi20:26:162
1231977992216,4cyclictest1263123-21unixbench_multi19:36:152
123197799220,7cyclictest1377702-21munin-run21:35:002
123197799220,5cyclictest1347018-21ntpq21:01:112
123197399228,3cyclictest15354572cut00:11:061
12315572225,11sleep10-21swapper/119:06:391
123197799216,5cyclictest0-21swapper/222:16:102
123197799216,2cyclictest13594912grep21:16:022
123197799212,6cyclictest39-21ksoftirqd/219:31:112
123197799212,5cyclictest0-21swapper/221:21:092
1231977992118,2cyclictest1452321-21cpuspeed_turbos22:50:572
123197799211,4cyclictest0-21swapper/223:06:062
1231977992111,2cyclictest161rcu_preempt22:24:182
123197799210,6cyclictest1513619-21tr23:51:032
123197799210,5cyclictest1327990-21sed20:45:012
123197399212,14cyclictest1336826-21taskset20:51:061
15003252200,5sleep3481ktimers/323:36:063
123197799208,3cyclictest161rcu_preempt19:49:372
123197799206,4cyclictest0-21swapper/223:11:122
123197799202,5cyclictest39-21ksoftirqd/200:15:572
1231977992017,2cyclictest1490338-21grep23:26:052
1231977992017,2cyclictest1248291-21unixbench_multi19:21:132
1231977992016,3cyclictest0-21swapper/200:00:562
1231977992015,3cyclictest0-21swapper/220:06:062
123197799200,12cyclictest39-21ksoftirqd/221:35:392
12310682204,9sleep20-21swapper/219:06:112
123197799194,11cyclictest1445999-21/usr/sbin/munin22:41:082
123197799192,5cyclictest0-21swapper/222:01:012
123197799192,5cyclictest0-21swapper/220:46:082
123197799192,4cyclictest0-21swapper/222:36:102
123197799192,4cyclictest0-21swapper/220:00:002
1231977991910,4cyclictest1353071-21apt-get21:10:542
123197799190,5cyclictest1303762-21cut20:20:572
123197799183,4cyclictest0-21swapper/222:45:342
123197799182,8cyclictest0-21swapper/220:15:592
123197799182,5cyclictest0-21swapper/219:25:572
1231977991815,2cyclictest1411925-21unixbench_singl22:06:152
1231977991810,6cyclictest1284358-21seq20:01:022
12271952184,8sleep30-21swapper/319:05:123
15238922167,5sleep30-21swapper/300:01:033
14177612154,8sleep30-21swapper/322:15:573
13570572145,5sleep30-21swapper/321:11:123
12738902132,7sleep30-21swapper/319:50:583
12725662132,7sleep30-21swapper/319:46:103
12585932132,6sleep30-21swapper/319:35:023
12437292132,7sleep30-21swapper/319:20:003
15503492122,6sleep30-21swapper/300:26:073
15415292122,5sleep30-21swapper/300:20:013
15368672122,6sleep30-21swapper/300:15:563
15290662122,6sleep30-21swapper/300:06:053
15076162122,6sleep30-21swapper/323:46:023
14866572122,6sleep30-21swapper/323:25:563
14720962122,6sleep30-21swapper/323:10:593
14666222122,5sleep30-21swapper/323:05:003
14619662122,6sleep30-21swapper/323:00:563
14579272122,6sleep30-21swapper/322:56:023
14419292122,5sleep30-21swapper/322:40:013
14372382122,6sleep30-21swapper/322:35:553
14278402122,6sleep30-21swapper/322:26:013
14236512122,6sleep30-21swapper/322:21:033
14129292122,6sleep30-21swapper/322:11:003
14077652122,6sleep30-21swapper/322:05:583
14059752122,6sleep30-21swapper/322:01:043
13868442122,6sleep30-21swapper/321:41:103
13681452122,5sleep30-21swapper/321:25:573
13675682122,5sleep30-21swapper/321:25:013
13577742122,5sleep30-21swapper/321:15:023
13486252122,6sleep30-21swapper/321:06:033
13426412122,5sleep30-21swapper/321:00:013
13380022122,6sleep30-21swapper/320:55:553
13329182122,5sleep30-21swapper/320:50:023
13269192120,8sleep30-21swapper/320:41:073
13221712122,6sleep30-21swapper/320:36:143
13105892122,6sleep30-21swapper/320:26:063
12888942122,6sleep30-21swapper/320:05:593
12837062122,6sleep30-21swapper/320:00:583
12642372122,6sleep30-21swapper/319:41:003
12543222122,6sleep30-21swapper/319:31:013
15565082112,5sleep30-21swapper/300:35:063
15515982112,5sleep30-21swapper/300:30:073
15318602112,5sleep30-21swapper/300:10:023
15167812112,5sleep30-21swapper/323:55:003
15159932112,5sleep30-21swapper/323:51:123
15059752112,5sleep30-21swapper/323:41:123
14912972112,5sleep30-21swapper/323:30:013
14560922112,5sleep30-21swapper/322:51:123
14471902112,5sleep30-21swapper/322:45:553
14321652112,5sleep30-21swapper/322:30:023
13986722112,5sleep30-21swapper/321:56:033
13962152112,5sleep30-21swapper/321:51:063
13772762112,5sleep30-21swapper/321:31:153
13321222112,5sleep30-21swapper/320:46:133
13030732112,5sleep30-21swapper/320:19:483
12935442112,5sleep30-21swapper/320:10:573
12831892112,5sleep30-21swapper/319:59:223
12492612112,5sleep30-21swapper/319:25:593
12477312112,5sleep30-21swapper/319:21:053
12321852112,5sleep30-21swapper/319:10:543
14766802102,5sleep30-21swapper/323:15:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional