You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 05:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Dec 16, 2025 00:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12535812740,6sleep1291ktimers/119:44:021
13665442660,5sleep20-21swapper/221:35:022
14439652550,4sleep30-21swapper/322:54:063
1220874994942,5cyclictest1371262-21latency_hist21:40:011
1220874994939,7cyclictest1376191-21latency_hist21:45:011
1220870994941,5cyclictest1326674-21latency_hist20:55:010
1220870994938,8cyclictest1544246-21latency_hist00:35:000
1220870994740,5cyclictest1340944-21kworker/u8:2+flush-8:021:14:040
1220874994642,3cyclictest1404076-21kworker/u8:3+events_unbound22:25:141
1220874994642,3cyclictest1404076-21kworker/u8:3+events_unbound22:25:131
1220874994542,2cyclictest1340944-21kworker/u8:2+events_unbound21:14:031
1220874994541,3cyclictest1480751-21kworker/u8:4+events_unbound00:00:381
1220874994339,3cyclictest1167905-21kworker/u8:0+events_unbound19:45:111
1220874994238,3cyclictest1167905-21kworker/u8:0+events_unbound21:20:301
1220874994138,2cyclictest1469982-21kworker/u8:1+events_unbound23:30:321
1220874994138,2cyclictest1267379-21kworker/u8:1+events_unbound20:40:311
1220870994132,6cyclictest1470109-21latency_hist23:20:010
1220874994037,2cyclictest1220542-21kworker/u8:3+events_unbound20:55:381
1220874994036,3cyclictest1469982-21kworker/u8:1+events_unbound23:29:401
1220874994036,3cyclictest1267379-21kworker/u8:1+events_unbound20:26:031
1220870994031,6cyclictest1420905-21latency_hist22:30:000
1220870994031,6cyclictest1420905-21latency_hist22:30:000
1220870994030,8cyclictest1400345-21ntpq22:09:120
1220874993935,3cyclictest1404076-21kworker/u8:3+events_unbound23:09:011
1220874993935,3cyclictest1247654-21kworker/u8:2+events_unbound19:39:301
1220874993930,7cyclictest1539836-21/usr/sbin/munin00:34:071
1220870993933,4cyclictest1188298-21kworker/u8:1+flush-8:019:29:110
1220870993929,7cyclictest1410811-21latency_hist22:20:000
12162002392,31sleep30-21swapper/319:08:553
1220870993828,8cyclictest1221610-21diskstats19:14:020
1220870993825,10cyclictest278-21systemd-journal20:15:010
12161762384,11sleep10-21swapper/119:08:371
1220874993733,3cyclictest1267379-21kworker/u8:1+events_unbound22:30:021
1220874993733,3cyclictest1220542-21kworker/u8:3+events_unbound20:39:011
1220874993728,7cyclictest1296948-21latency_hist20:25:001
1220870993732,4cyclictest1220542-21kworker/u8:3+flush-8:020:49:070
14634912360,6sleep1281rcuc/123:14:071
1220870993630,4cyclictest1351373-21systemd-run21:20:000
1220870993626,7cyclictest1519409-21latency_hist00:10:010
1220878993526,7cyclictest278-21systemd-journal00:20:002
1220874993532,2cyclictest1421297-21kworker/u8:2+events_unbound23:16:231
1220874993531,3cyclictest1480751-21kworker/u8:4+events_unbound00:21:561
1220874993531,3cyclictest1267379-21kworker/u8:1+events_unbound20:32:551
1220874993531,3cyclictest1267379-21kworker/u8:1+events_unbound20:05:531
1220874993531,3cyclictest1220542-21kworker/u8:3+events_unbound19:15:011
1220870993528,5cyclictest1220542-21kworker/u8:3+events_unbound19:15:020
1220870993525,8cyclictest1533505-21ntpq00:24:110
12594152340,6sleep20-21swapper/219:49:062
1220874993431,2cyclictest1247654-21kworker/u8:2+events_unbound19:50:011
1220874993430,3cyclictest1267379-21kworker/u8:1+events_unbound22:11:161
1220870993424,7cyclictest1237844-21latency_hist19:25:010
1220874993329,3cyclictest1220542-21kworker/u8:3+events_unbound20:53:541
1220870993323,8cyclictest1528573-21ntpq00:19:100
1220874993229,2cyclictest1340944-21kworker/u8:2+events_unbound22:02:541
1220874993229,2cyclictest1220542-21kworker/u8:3+events_unbound19:15:531
1220874993228,3cyclictest1404076-21kworker/u8:3+events_unbound22:16:531
1220874993228,3cyclictest1188298-21kworker/u8:1+events_unbound19:28:541
1220874993225,1cyclictest161rcu_preempt00:14:131
1220870993227,3cyclictest1267379-21kworker/u8:1+events_unbound20:24:060
1220874993128,2cyclictest1469982-21kworker/u8:1+events_unbound23:23:311
1220874993128,2cyclictest1421297-21kworker/u8:2+events_unbound23:04:091
1220874993128,2cyclictest1421297-21kworker/u8:2+events_unbound22:35:391
1220874993128,2cyclictest1340944-21kworker/u8:2+events_unbound22:07:131
1220874993127,3cyclictest1480456-21kworker/u8:2+events_unbound23:51:551
1220874993126,3cyclictest1539299-21cron00:30:001
1220874993126,3cyclictest1337793-21irqrtprio21:09:041
1220874993126,3cyclictest1284877-21kthreadcore20:14:081
1220870993127,2cyclictest1499532-21unixbench_multi23:49:170
1220870993127,2cyclictest1247664-21cron19:35:000
1220870993125,4cyclictest1453140-21kthreadcore23:04:070
1220870993123,6cyclictest1385368-21ntpq21:54:110
1220870993120,9cyclictest1253428-21diskstats19:44:010
1220874993027,2cyclictest1267379-21kworker/u8:1+events_unbound19:59:391
1220874993027,2cyclictest1188298-21kworker/u8:1+events_unbound19:30:531
1220874993026,3cyclictest1404076-21kworker/u8:3+events_unbound22:58:531
1220874993026,3cyclictest1340944-21kworker/u8:2+events_unbound21:32:551
1220874993023,5cyclictest1220542-21kworker/u8:3+flush-8:019:23:591
1220874993022,6cyclictest278-21systemd-journal00:09:531
1220870993023,5cyclictest1340944-21kworker/u8:2+flush-8:021:49:020
1220870993022,6cyclictest1444913-21ntpq22:54:110
122087899299,4cyclictest0-21swapper/223:44:142
1220878992922,5cyclictest1301863-21apt-get20:30:002
1220874992926,2cyclictest1421297-21kworker/u8:2+events_unbound22:54:541
1220874992925,3cyclictest1480751-21kworker/u8:4+events_unbound23:57:081
1220874992925,3cyclictest1480456-21kworker/u8:2+events_unbound23:46:321
1220874992925,3cyclictest1404076-21kworker/u8:3+events_unbound22:40:141
1220874992925,3cyclictest1340944-21kworker/u8:2+events_unbound21:56:331
1220874992925,3cyclictest1267379-21kworker/u8:1+events_unbound22:21:531
1220874992925,3cyclictest1267379-21kworker/u8:1+events_unbound21:53:391
122087499290,7cyclictest1491488-21tr23:44:061
1220870992924,4cyclictest1267379-21kworker/u8:1+flush-8:021:44:040
1220870992922,5cyclictest1263005-21apt-get19:54:000
12159882293,8sleep20-21swapper/219:06:092
1220878992824,3cyclictest1220542-21kworker/u8:3+flush-8:019:15:142
1220874992825,2cyclictest1499682-21kworker/u8:1+events_unbound00:15:491
1220874992825,2cyclictest1267379-21kworker/u8:1+events_unbound20:17:331
1220874992825,2cyclictest1267379-21kworker/u8:1+events_unbound20:17:331
1220874992824,3cyclictest1539243-21kworker/u8:0+events_unbound00:38:301
1220874992824,3cyclictest1480456-21kworker/u8:2+events_unbound23:38:121
1220874992824,3cyclictest1340944-21kworker/u8:2+events_unbound21:47:051
1220874992824,3cyclictest1220542-21kworker/u8:3+events_unbound21:04:561
1220874992824,3cyclictest1220542-21kworker/u8:3+events_unbound20:01:011
1220874992824,3cyclictest1167905-21kworker/u8:0+events_unbound21:28:321
1220874992814,2cyclictest161rcu_preempt22:48:581
122087099283,23cyclictest1440609-21kworker/0:1+events23:44:170
1220870992823,4cyclictest1267379-21kworker/u8:1+flush-8:021:39:240
1220870992822,4cyclictest1480751-21kworker/u8:4+events_unbound23:55:520
1220874992721,4cyclictest1317427-21apt-get20:48:571
1220870992723,2cyclictest1332874-21irqrtprio21:04:050
1220870992719,6cyclictest1524315-21latency_hist00:15:010
1220878992623,2cyclictest1431633-21fschecks_time22:44:022
1220878992621,3cyclictest0-21swapper/219:15:002
122087899261,10cyclictest14439692kthreadcore22:54:062
1220870992622,3cyclictest1395837-21cat22:05:000
1220870992622,3cyclictest1390872-21idleruntime-cro22:00:010
122087099262,23cyclictest1282200-21kworker/0:1+events20:19:090
122087099262,23cyclictest1282200-21kworker/0:1+events20:19:090
1220870992622,2cyclictest1427147-21irqrtprio22:39:050
1220870992621,4cyclictest1220542-21kworker/u8:3+flush-8:020:38:240
1220870992620,4cyclictest1404076-21kworker/u8:3+events_unbound23:29:160
1220870992620,4cyclictest1313456-21kthreadcore20:44:060
1220870992619,5cyclictest1404076-21kworker/u8:3+events_unbound22:15:010
1220870992618,6cyclictest1341368-21unixbench_singl21:09:170
1220870992618,3cyclictest0-21swapper/020:29:110
1220878992522,2cyclictest1292624-21aten2_r5power_e20:24:002
122087099256,18cyclictest1519448-21kworker/0:2+events00:25:010
122087099252,22cyclictest351364-21kworker/0:3+events19:49:090
1220870992521,3cyclictest1327446-21tr20:59:010
122087099250,23cyclictest1455733-21sshd23:06:530
1220878992421,2cyclictest1515059-21aten2_r5power_c00:09:002
1220878992420,2cyclictest1371945-21aten2_r5power_v21:44:012
1220878992420,2cyclictest1287769-21aten2_r5power_v20:19:002
1220878992420,2cyclictest1287769-21aten2_r5power_v20:19:002
1220878992420,2cyclictest0-21swapper/200:35:002
1220878992419,3cyclictest1346381-21cron21:15:002
1220878992417,5cyclictest1415957-21cron22:25:002
122087499245,12cyclictest30-21ksoftirqd/121:19:161
122087099249,7cyclictest521rcuop/320:04:440
122087099242,21cyclictest1361466-21kworker/0:0+events22:46:530
1220870992420,2cyclictest0-21swapper/021:25:000
1220870992419,3cyclictest0-21swapper/021:30:010
1220870992419,3cyclictest0-21swapper/000:05:010
1220870992418,4cyclictest1421297-21kworker/u8:2+flush-8:022:59:140
1220870992416,6cyclictest278-21systemd-journal22:35:000
1220870992415,7cyclictest1503939-21ntpq23:54:120
1220870992414,8cyclictest1464548-21ntpq23:14:090
122087099241,22cyclictest1440609-21kworker/0:1+events23:39:050
122087099240,23cyclictest1361466-21kworker/0:0+events22:44:050
1220878992319,3cyclictest1545113-21fschecks_time00:39:022
1220878992319,3cyclictest1307030-21latency_hist20:35:002
1220878992319,2cyclictest1481612-21kthreadcore23:34:062
1220878992319,2cyclictest0-21swapper/219:24:022
1220878992318,4cyclictest1415989-21kworker/u8:0+flush-8:023:21:292
122087099233,19cyclictest351364-21kworker/0:3+events20:06:490
122087099233,19cyclictest351364-21kworker/0:3+events19:38:410
122087099232,20cyclictest1440609-21kworker/0:1+events23:21:290
1220870992319,2cyclictest0-21swapper/020:34:000
12258302220,3sleep3575-21kworker/3:2+events19:15:003
122087899222,14cyclictest1317427-21apt-get20:48:592
1220878992219,2cyclictest1238633-21cpuspeed_turbos19:29:012
1220878992218,2cyclictest1322423-21aten2_r5power_p20:54:002
1220878992217,4cyclictest1499682-21kworker/u8:1+flush-8:000:14:062
122087099225,16cyclictest351364-21kworker/0:3+events19:58:580
1220870992218,2cyclictest1366105-21cron21:35:000
1220870992216,4cyclictest1267379-21kworker/u8:1+flush-8:022:20:240
1220878992118,2cyclictest1390764-21unixbench_singl21:59:192
1220878992117,2cyclictest1455952-21aten2_r5power_c23:09:002
1220878992117,2cyclictest1332451-21fschecks_count21:04:022
1220878992116,4cyclictest1167905-21kworker/u8:0+flush-8:021:19:052
1220878992115,4cyclictest1480751-21kworker/u8:4+flush-8:000:24:082
122087899210,9cyclictest13826092grep21:54:062
1220870992111,8cyclictest0-21swapper/023:34:030
12204492212,13sleep00-21swapper/019:09:280
15191592200,3chrt575-21kworker/3:2-events00:09:173
122087899206,2cyclictest0-21swapper/223:29:292
122087899203,3cyclictest13993202cut22:09:082
1220878992015,3cyclictest1449969-21grep22:59:182
1220878992015,3cyclictest0-21swapper/222:05:002
1220878992014,4cyclictest1489667-21unixbench_multi23:39:192
122087099203,16cyclictest1519448-21kworker/0:2+events00:39:010
122087899196,2cyclictest0-21swapper/222:49:132
122087899194,13cyclictest1500324-21cut23:54:002
122087899194,13cyclictest1452855-21cut23:04:062
1220878991915,2cyclictest1327447-21cpuspeed_turbos20:59:012
1220878991914,4cyclictest1380919-21unixbench_multi21:49:182
1220878991911,6cyclictest1315615-21kthreadcore20:44:082
122087899185,11cyclictest1249149-21kthreadcore19:39:052
122087899182,11cyclictest1460829-21apt-get23:13:592
1220878991815,2cyclictest0-21swapper/222:35:002
1220878991814,3cyclictest911-21mta-sts-daemon21:29:062
1220878991814,3cyclictest0-21swapper/221:24:192
1220878991814,2cyclictest1272930-21aten2_r5power_e20:04:012
1220878991813,4cyclictest1267379-21kworker/u8:1+flush-8:021:39:022
1220878991813,3cyclictest0-21swapper/221:09:022
122087899173,3cyclictest0-21swapper/219:53:272
122087899172,11cyclictest1420259-21ntpq22:29:092
122087899172,11cyclictest1420259-21ntpq22:29:092
1220878991713,2cyclictest0-21swapper/200:05:002
122087899171,2cyclictest12800191kthreadcore20:09:072
1220878991712,3cyclictest1246088-21kthreadcore19:34:072
1220878991712,3cyclictest0-21swapper/222:14:192
14509882162,9sleep30-21swapper/323:03:593
122087899168,6cyclictest1268264-21grep19:59:022
122087899162,13cyclictest0-21swapper/223:55:312
122087899162,13cyclictest0-21swapper/220:37:332
1220878991613,2cyclictest0-21swapper/220:13:062
1220878991613,2cyclictest0-21swapper/219:42:292
1220878991613,2cyclictest0-21swapper/200:26:002
1220878991612,2cyclictest0-21swapper/222:39:052
122087899161,11cyclictest1465771-21apt-get23:19:012
14855202155,6sleep30-21swapper/323:39:013
122087899157,5cyclictest1499190-21processes23:49:142
122087899152,2cyclictest0-21swapper/222:16:352
12826922142,8sleep30-21swapper/320:13:593
15393012132,6sleep30-21swapper/300:30:013
15297812132,7sleep30-21swapper/300:23:593
14266772132,7sleep30-21swapper/322:39:033
14153132132,7sleep30-21swapper/322:24:103
13821082132,6sleep30-21swapper/321:54:053
13521522133,7sleep30-21swapper/321:24:043
13162472132,7sleep30-21swapper/320:44:123
12919762132,6sleep30-21swapper/320:20:003
12919762132,6sleep30-21swapper/320:20:003
12673462132,6sleep30-21swapper/319:55:013
12423712132,7sleep30-21swapper/319:29:173
12342082133,7sleep30-21swapper/319:24:033
15468452122,5sleep30-21swapper/300:39:073
15253722122,6sleep30-21swapper/300:19:053
15060532122,6sleep30-21swapper/323:59:073
14911522122,6sleep30-21swapper/323:44:073
14750742122,5sleep30-21swapper/323:25:013
14704502122,6sleep30-21swapper/323:21:243
14662602122,6sleep30-21swapper/323:19:073
14575672123,6sleep30-21swapper/323:09:083
14503872122,6sleep30-21swapper/322:59:533
14353022122,7sleep30-21swapper/322:44:163
14219342122,6sleep30-21swapper/322:34:063
13958182122,7sleep30-21swapper/322:05:003
13860122122,6sleep30-21swapper/321:55:013
13464162122,6sleep30-21swapper/321:15:013
13370762122,6sleep30-21swapper/321:08:593
13326842122,6sleep30-21swapper/321:04:073
13081102122,6sleep30-21swapper/320:39:063
13031062123,5sleep30-21swapper/320:34:053
13015572122,6sleep30-21swapper/320:29:193
12925382122,6sleep30-21swapper/320:23:583
12811792122,6sleep30-21swapper/320:09:093
12688032122,6sleep30-21swapper/319:59:063
12584742122,6sleep30-21swapper/319:49:033
12573542122,6sleep30-21swapper/319:44:173
12475892122,6sleep30-21swapper/319:34:183
15346212112,5sleep30-21swapper/300:25:033
15196402112,5sleep30-21swapper/300:10:113
15103292112,5sleep30-21swapper/300:04:053
14999832112,6sleep30-21swapper/323:51:173
14950652112,6sleep30-21swapper/323:46:113
14826572111,5sleep30-21swapper/323:34:083
14605842112,6sleep30-21swapper/323:11:093
14359812112,6sleep30-21swapper/322:46:053
14162402112,6sleep30-21swapper/322:25:393
14162402112,6sleep30-21swapper/322:25:393
14064302112,6sleep30-21swapper/322:19:013
14013432112,5sleep30-21swapper/322:12:113
14006512112,5sleep30-21swapper/322:09:183
13715582112,6sleep30-21swapper/321:40:493
13668712112,6sleep30-21swapper/321:38:563
13615862112,6sleep30-21swapper/321:32:263
13566112112,6sleep30-21swapper/321:26:213
13419752112,6sleep30-21swapper/321:13:533
13310852112,5sleep30-21swapper/320:59:163
13261612112,6sleep30-21swapper/320:54:153
13174012112,5sleep30-21swapper/320:48:573
12728742112,5sleep30-21swapper/320:03:593
12480052112,6sleep30-21swapper/319:36:273
12271302112,6sleep30-21swapper/319:15:053
13764312102,5sleep30-21swapper/321:45:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional