You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 14:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot4s.osadl.org (updated Thu Sep 18, 2025 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
130382722020,3sleep3662-21kworker/3:2+events09:30:553
12419022730,3chrt662-21kworker/3:2-events08:30:483
12111112560,4sleep10-21swapper/108:00:411
1159372995546,6cyclictest1180931-21latency_hist07:30:011
1159368995444,6cyclictest2583070-21systemd-journal09:55:000
1159372995039,8cyclictest1393657-21ntpq11:00:531
1159368995040,7cyclictest1419398-21apt-get11:30:000
1159372994940,6cyclictest1225587-21latency_hist08:15:001
1159372994839,7cyclictest2583070-21systemd-journal07:39:151
1159368994842,4cyclictest1469431-21apt-get12:20:440
1159372994738,6cyclictest1459241-21latency_hist12:10:011
1159372994538,5cyclictest1245418-21latency_hist08:35:011
1159372994534,8cyclictest2583070-21systemd-journal11:11:481
1159368994537,6cyclictest1210825-21latency_hist08:00:010
1159368994534,8cyclictest1384349-21apt-get10:55:010
1159372994435,7cyclictest1335112-21/usr/sbin/munin10:06:021
1159368994438,4cyclictest1275340-21kworker/u8:1+events_unbound09:15:000
1159372994337,4cyclictest1106639-21kworker/u8:0+flush-8:007:50:461
1159368994331,8cyclictest2583070-21systemd-journal08:50:000
1159368994232,7cyclictest2583070-21systemd-journal07:45:000
1159372994136,3cyclictest1154260-21kworker/u8:2+flush-8:008:20:471
1159372994132,6cyclictest1324924-21latency_hist09:55:011
1159372994029,8cyclictest2583070-21systemd-journal12:32:361
1159372993935,3cyclictest1294251-21kworker/u8:2+flush-8:010:46:021
1159372993934,3cyclictest1250603-21kworker/u8:0+flush-8:009:00:431
1159372993931,5cyclictest1413584-21ntpq11:20:551
1159372993931,5cyclictest1200057-21ntpq07:45:531
115902523927,6sleep10-21swapper/107:08:051
1159374993829,7cyclictest2583070-21systemd-journal10:24:152
1159372993834,3cyclictest1106639-21kworker/u8:0+events_unbound08:06:001
1159372993832,4cyclictest1454307-21latency_hist12:05:011
1159372993831,5cyclictest1154260-21kworker/u8:2+flush-8:007:10:451
1159372993830,6cyclictest1398674-21ntpq11:05:551
1159372993829,7cyclictest1275340-21kworker/u8:1+flush-8:009:16:071
1159372993829,7cyclictest1275340-21kworker/u8:1+flush-8:009:16:071
1159372993828,7cyclictest1423723-21ntpq11:30:551
1159372993730,5cyclictest2583070-21systemd-journal11:20:001
1159372993631,4cyclictest1294251-21kworker/u8:2+flush-8:010:35:461
1159372993630,4cyclictest1439781-21apt-get11:50:411
1159372993630,4cyclictest1439781-21apt-get11:50:411
1159368993630,4cyclictest1434077-21kworker/u8:3+flush-8:012:15:480
1159368993627,7cyclictest1186415-21diskstats07:35:450
1159372993531,3cyclictest1106639-21kworker/u8:0+flush-8:007:56:051
1159372993530,3cyclictest1225838-21kworker/u8:1+flush-8:008:25:461
1159368993525,7cyclictest1448435-21ntpq11:55:550
1159374993429,3cyclictest1235533-21turbostat.cron08:25:002
1159368993425,6cyclictest1279787-21sshd09:06:310
1159372993328,4cyclictest1384811-21kworker/u8:3+events_unbound10:55:561
1159372993327,4cyclictest2583070-21systemd-journal11:28:191
1159372993327,4cyclictest1275413-21apt-get09:05:421
1159372993327,4cyclictest1250603-21kworker/u8:0+events_unbound09:30:481
1159372993325,6cyclictest1225889-21apt-get08:15:411
1159368993325,6cyclictest1219766-21ntpq08:05:540
1159368993319,2cyclictest161rcu_preempt07:20:530
1159372993226,4cyclictest1191147-21apt-get07:40:391
1159372993225,5cyclictest1249500-21ntpq08:35:561
1159372993225,5cyclictest1225838-21kworker/u8:1+events_unbound08:45:561
1159372993222,8cyclictest1313935-21ntpq09:40:591
11591202324,9sleep20-21swapper/207:09:182
1159372993126,3cyclictest1446862-21kthreadcore11:55:521
1159372993124,5cyclictest1154260-21kworker/u8:2+events_unbound07:15:451
1159372993122,7cyclictest1369809-21/usr/sbin/munin10:40:541
115936899314,15cyclictest1241226-21if_enp4s0.308:30:460
1159368993126,3cyclictest1200556-21unixbench_multi07:46:000
1159372993025,3cyclictest1465035-21irqcore12:15:471
1159372993023,5cyclictest1250603-21kworker/u8:0+events_unbound09:35:591
115936899305,14cyclictest663-21runrttasks08:35:420
1159368993022,6cyclictest1265177-21latency_hist08:55:010
1159368993020,8cyclictest1453412-21ntpq12:00:530
1159368993019,3cyclictest421rcuog/210:45:430
1159374992924,3cyclictest1488912-21apt-get12:40:002
1159372992925,3cyclictest1470020-21irqcore12:20:521
1159372992925,3cyclictest1314749-21kworker/u8:1+flush-8:012:36:071
1159372992924,3cyclictest1267646-21kthreadcore08:55:501
115936899299,5cyclictest1460559-21cat12:10:480
115936899298,6cyclictest1269719-21grep08:56:010
115936899298,12cyclictest1350359-21perl10:20:520
115936899295,7cyclictest1255322-21idleruntime-cro08:45:000
115936899294,4cyclictest1309002-21ntp_states09:35:590
115936899292,26cyclictest3973087-21kworker/0:2+events10:25:500
1159368992919,8cyclictest1433611-21ntpq11:40:550
1159368992914,2cyclictest0-21swapper/011:00:420
115936899291,16cyclictest1166753-21hddtemp_smartct07:15:450
1159368992910,11cyclictest0-21swapper/010:16:010
11950872280,6sleep3662-21kworker/3:2+events07:40:563
1159374992823,3cyclictest1429157-21unixbench_multi11:35:592
1159372992824,3cyclictest1106639-21kworker/u8:0+flush-8:007:30:461
1159372992823,4cyclictest1359242-21kworker/u8:3+events_unbound10:30:441
1159372992822,4cyclictest1344988-21kworker/u8:0+events_unbound10:25:471
1159372992821,5cyclictest2583070-21systemd-journal10:13:151
115936899287,14cyclictest1403649-21ntpq11:10:570
115936899287,11cyclictest1477440-21kthreadcore12:25:520
115936899283,10cyclictest1479609-21uniq12:30:440
1159368992822,4cyclictest1409461-21sendmail11:20:000
1159368992822,4cyclictest1294251-21kworker/u8:2+flush-8:009:57:210
1159368992821,5cyclictest1299883-21latency_hist09:30:010
1159368992813,2cyclictest0-21swapper/011:46:010
1159368992813,2cyclictest0-21swapper/009:45:470
1159374992724,2cyclictest1429920-21aten2_r5power_c11:40:432
1159374992719,5cyclictest2583070-21systemd-journal08:45:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional