You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 11:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Aug 30, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1252308994641,4cyclictest1512270-21apt-get23:20:122
1252306994337,5cyclictest1413033-21store21:45:011
1252308994036,3cyclictest1527563-21gpgv23:35:002
1252306994033,5cyclictest335557-21systemd-journal00:35:011
1252306993832,4cyclictest1345902-21apt-get20:40:101
1252306993522,11cyclictest1396442-21ntpq21:25:211
1252312993429,4cyclictest1459819-21latency_hist22:30:013
1252306993429,3cyclictest1294274-21apt-get19:50:111
1252312993329,3cyclictest1376896-21kworker/u8:2+flush-259:021:35:003
1252308993126,3cyclictest1486175-21kworker/u8:1+flush-259:023:40:162
1252312993026,3cyclictest1449227-21kworker/u8:0+flush-259:023:00:213
1252312993025,4cyclictest1480553-21latency_hist22:50:003
1252306992924,3cyclictest1449484-21latency_hist22:20:011
1252302992925,2cyclictest1517452-21apt-get23:25:120
1252312992825,2cyclictest1511743-21kworker/u8:0+flush-259:023:50:153
1252306992823,3cyclictest1585477-21apt-get00:30:131
1252302992721,4cyclictest1314667-21latency_hist20:10:000
1252308992620,4cyclictest1277161-21ntpq19:30:222
1252302992620,4cyclictest1548850-21apt-get23:55:130
1252306992514,10cyclictest335557-21systemd-journal23:15:001
1252302992521,3cyclictest1407665-21kworker/u8:4+flush-259:021:50:280
1252312992418,4cyclictest1252685-21diskstats19:10:133
1252302992417,5cyclictest1391313-21ntpq21:20:220
1252302992417,5cyclictest1391313-21ntpq21:20:210
1252308992320,2cyclictest1304355-21kworker/u8:2+flush-259:020:20:132
1252306992318,3cyclictest1376909-21/usr/sbin/munin21:10:151
1252306992310,11cyclictest1507183-21cpuspeed_turbos23:15:141
1252302992317,4cyclictest1580010-21latency_hist00:25:010
1252312992216,4cyclictest1575091-21/usr/sbin/munin00:20:143
125230899221,19cyclictest1402488-21unin-run21:35:002
1252306992210,1cyclictest1319723-21pool-/usr/bin/f20:13:571
1252302992217,4cyclictest1340724-21apt-get20:35:090
1252312992119,1cyclictest0-21swapper/322:20:003
1252312992117,3cyclictest1268007-21/usr/sbin/munin19:25:143
1252312992115,4cyclictest1580246-21/usr/sbin/munin00:25:203
1252308992117,3cyclictest1449227-21kworker/u8:0+flush-259:023:00:152
125230699219,2cyclictest1424007-21cpuspeed_turbos21:55:141
1252306992118,2cyclictest1273188-21apt-get19:30:131
1252302992118,2cyclictest0-21swapper/022:25:000
1252302992116,3cyclictest1543831-21diskstats23:50:120
1252302992115,4cyclictest1474428-21ntpq22:40:220
1252312992014,4cyclictest1590410-21apt-get00:35:003
1252306992016,3cyclictest1376896-21kworker/u8:2+flush-259:021:50:001
1252306992015,3cyclictest1251383-21kworker/u8:0+flush-259:019:15:171
1252302992017,2cyclictest1486161-21sh22:55:000
125230299201,18cyclictest1-21systemd21:04:070
1252312991916,1cyclictest0-21swapper/322:15:003
1252312991914,4cyclictest335557-21systemd-journal20:11:063
1252312991914,4cyclictest335557-21systemd-journal20:00:003
1252306991915,3cyclictest1304578-21/usr/sbin/munin20:00:131
1252306991912,5cyclictest1360238-21ntpq20:50:211
1252302991915,3cyclictest1325226-21/usr/sbin/munin20:20:190
1252312991816,1cyclictest0-21swapper/323:20:003
1252312991815,2cyclictest1419135-21irqcore21:50:163
1252312991814,3cyclictest1460060-21/usr/sbin/munin22:30:143
1252308991816,1cyclictest1585191-21idleruntime-cro00:30:002
1252312991714,2cyclictest1291415-21kthreadcore19:45:173
1252312991714,2cyclictest1289093-21kworker/u8:0+flush-259:020:54:593
1252312991714,2cyclictest1252297-21cyclictest20:40:003
125230899177,4cyclictest1366308-21munin-run21:00:002
1252306991714,2cyclictest1-21systemd00:27:541
1252302991714,2cyclictest60350irq/132-enp0s29f1:rx-020:10:150
1252302991714,2cyclictest1299448-21apt-get19:55:110
1252302991713,2cyclictest1387026-21unin-run21:20:000
1252302991711,5cyclictest1511162-21ntpq23:15:230
125231299168,6cyclictest1375742-21ntpq21:05:203
1252312991613,2cyclictest1527812-21latency_hist23:35:013
1252312991613,2cyclictest1252297-21cyclictest21:15:243
1252312991611,4cyclictest1490475-21ntpq22:55:223
1252312991610,4cyclictest1528299-21diskstats23:35:143
1252312991610,4cyclictest1528299-21diskstats23:35:143
1252308991614,1cyclictest1574843-21idleruntime-cro00:20:002
1252308991614,1cyclictest0-21swapper/219:29:592
1252308991613,2cyclictest0-21swapper/220:15:002
1252308991611,4cyclictest1480583-21gpgv22:50:002
1252308991611,4cyclictest1283862-21cat19:40:002
1252306991613,2cyclictest1332724-21kthreadcore20:25:181
1252306991611,3cyclictest1387011-21basename21:19:591
1252302991614,1cyclictest60350irq/132-enp0s29f1:rx-000:29:270
1252302991613,2cyclictest60350irq/132-enp0s29f1:rx-023:45:150
1252302991613,2cyclictest60350irq/132-enp0s29f1:rx-021:12:020
1252302991613,2cyclictest60350irq/132-enp0s29f1:rx-020:47:270
1252302991613,2cyclictest60350irq/132-enp0s29f1:rx-020:25:210
1252302991613,2cyclictest1434290-21apt-get22:05:120
1252302991612,3cyclictest1559633-21apt-get00:05:130
1252302991612,3cyclictest1289093-21kworker/u8:0+flush-259:020:20:010
1252302991611,4cyclictest1335744-21diskstats20:30:130
1252312991513,1cyclictest0-21swapper/322:25:003
1252312991512,2cyclictest1519729-21kthreadcore23:25:183
1252312991512,1cyclictest1475371-21turbostat22:45:013
1252312991511,3cyclictest1486175-21kworker/u8:1+flush-259:000:05:183
1252312991510,3cyclictest1549027-21cut23:55:163
1252312991510,3cyclictest1538243-21kworker/u8:3+events_unbound00:00:183
1252308991512,2cyclictest1560655-21kthreadcore00:05:192
1252308991512,2cyclictest1540800-21kthreadcore23:45:182
1252308991512,2cyclictest1429051-21kworker/u8:2+flush-259:022:15:172
1252308991511,3cyclictest335557-21systemd-journal23:18:102
125230699159,4cyclictest1543407-21latency_hist23:50:001
1252306991512,2cyclictest1476036-21irqcore22:45:171
125230299159,4cyclictest335557-21systemd-journal19:26:060
125230299158,5cyclictest1558510-21ntpq00:00:230
1252302991513,2cyclictest61150irq/133-enp0s29f1:tx-020:00:150
1252302991513,1cyclictest60350irq/132-enp0s29f1:rx-023:20:120
1252302991513,1cyclictest60350irq/132-enp0s29f1:rx-021:40:170
1252302991513,1cyclictest60350irq/132-enp0s29f1:rx-021:35:150
1252302991513,1cyclictest60350irq/132-enp0s29f1:rx-021:30:260
1252302991513,1cyclictest60350irq/132-enp0s29f1:rx-020:58:440
1252302991513,1cyclictest60350irq/132-enp0s29f1:rx-019:40:200
1252302991512,2cyclictest60350irq/132-enp0s29f1:rx-022:35:110
1252302991512,2cyclictest60350irq/132-enp0s29f1:rx-021:05:210
1252302991512,2cyclictest60350irq/132-enp0s29f1:rx-019:40:000
1252302991511,3cyclictest1569942-21apt-get00:15:130
1252302991511,3cyclictest1454426-21kworker/u8:1+flush-259:022:30:160
1252302991510,4cyclictest1500758-21ntpq23:05:210
125231299149,4cyclictest335557-21systemd-journal19:32:073
1252312991410,3cyclictest1402729-21apt-get21:35:123
1252312991410,3cyclictest1199190-21kworker/u8:2+flush-259:019:35:173
1252312991410,2cyclictest0-21swapper/321:45:013
125230899149,3cyclictest1554376-21cp00:00:012
125230899148,4cyclictest1407644-21latency_hist21:40:012
1252308991412,1cyclictest0-21swapper/222:35:012
1252308991411,2cyclictest0-21swapper/220:50:002
1252308991410,3cyclictest1289093-21kworker/u8:0+flush-259:020:52:292
125230699149,3cyclictest1371209-21kworker/u8:3+flush-259:022:10:171
125230699146,7cyclictest335557-21systemd-journal19:40:011
1252306991412,1cyclictest1544079-21irqcore23:50:141
1252306991412,1cyclictest0-21swapper/123:35:001
1252306991411,2cyclictest1496466-21sh23:05:001
1252306991411,2cyclictest1262973-21cpuspeed_turbos19:20:131
1252302991413,1cyclictest60350irq/132-enp0s29f1:rx-021:25:050
1252302991412,1cyclictest60350irq/132-enp0s29f1:rx-023:35:200
1252302991412,1cyclictest60350irq/132-enp0s29f1:rx-023:35:200
1252302991412,1cyclictest60350irq/132-enp0s29f1:rx-022:00:250
1252302991412,1cyclictest60350irq/132-enp0s29f1:rx-020:50:250
1252302991412,1cyclictest60350irq/132-enp0s29f1:rx-019:50:140
1252302991412,1cyclictest60350irq/132-enp0s29f1:rx-019:30:170
1252302991412,1cyclictest60350irq/132-enp0s29f1:rx-019:20:220
1252302991412,1cyclictest60350irq/132-enp0s29f1:rx-019:15:140
1252302991411,2cyclictest61150irq/133-enp0s29f1:tx-019:10:180
1252302991411,2cyclictest60350irq/132-enp0s29f1:rx-023:10:200
1252302991411,2cyclictest60350irq/132-enp0s29f1:rx-021:55:250
1252302991411,2cyclictest60350irq/132-enp0s29f1:rx-019:45:240
1252302991411,2cyclictest60350irq/132-enp0s29f1:rx-000:35:020
1252302991411,2cyclictest1564983-21fschecks_time00:10:120
125231299139,3cyclictest1366568-21apt-get21:00:123
125231299139,3cyclictest1294249-21/usr/sbin/munin19:50:143
125231299139,2cyclictest0-21swapper/321:25:003
125231299139,2cyclictest0-21swapper/321:25:003
125231299137,4cyclictest1485244-21ntpq22:50:203
125231299131,3cyclictest1335314-21awk20:30:003
1252312991310,2cyclictest1502108-21fschecks_count23:10:133
125230899139,3cyclictest1579936-21kworker/u8:3+flush-259:000:40:002
125230899139,3cyclictest1532085-21grep23:35:202
125230899139,3cyclictest1532085-21grep23:35:202
125230899139,3cyclictest1325002-21kworker/u8:1+flush-259:020:25:232
125230899139,3cyclictest1251383-21kworker/u8:0+flush-259:019:15:002
125230899137,4cyclictest1299175-21awk19:55:012
1252308991310,2cyclictest1548917-21cpuspeed_turbos23:55:142
1252308991310,2cyclictest1481314-21cpuspeed_turbos22:50:132
1252308991310,2cyclictest1289093-21kworker/u8:0+flush-259:020:40:152
1252308991310,2cyclictest1278540-21fschecks_count19:35:142
1252308991310,2cyclictest1267304-21unixbench_multi19:20:242
1252308991310,2cyclictest0-21swapper/200:35:012
125230699138,3cyclictest509-21rs:main1
1252306991311,1cyclictest0-21swapper/122:45:011
1252306991310,2cyclictest1455190-21fschecks_time22:25:151
1252306991310,2cyclictest1345217-21unixbench_singl20:35:221
1252302991311,1cyclictest60350irq/132-enp0s29f1:rx-023:30:230
1252302991311,1cyclictest60350irq/132-enp0s29f1:rx-022:17:250
1252302991311,1cyclictest60350irq/132-enp0s29f1:rx-022:10:160
1252302991311,1cyclictest60350irq/132-enp0s29f1:rx-021:45:130
1252302991311,1cyclictest60350irq/132-enp0s29f1:rx-020:40:150
1252302991310,2cyclictest60350irq/132-enp0s29f1:rx-022:25:140
125231299128,3cyclictest1325251-21apt-get20:20:113
125231299128,2cyclictest0-21swapper/321:25:223
125231299126,5cyclictest1573958-21ntpq00:15:213
125231299121,9cyclictest1366303-21latency_hist21:00:013
1252312991210,1cyclictest1568691-21needreboot00:10:173
125230899129,2cyclictest1579082-21ntp_kernel_err00:20:192
125230899129,2cyclictest1449819-21cpuspeed_turbos22:20:132
125230899129,2cyclictest1418438-21idleruntime-cro21:50:002
125230899129,2cyclictest1396900-21unixbench_singl21:25:242
125230899129,2cyclictest0-21swapper/222:05:192
125230899128,3cyclictest1289093-21kworker/u8:0+flush-259:020:05:222
1252308991210,1cyclictest1324985-21idleruntime-cro20:20:012
1252308991210,1cyclictest0-21swapper/223:15:002
1252308991210,1cyclictest0-21swapper/222:15:002
1252308991210,1cyclictest0-21swapper/221:40:162
125230699129,2cyclictest335557-21systemd-journal21:04:061
125230699129,2cyclictest1268156-21cpuspeed_turbos19:25:121
125230699129,2cyclictest0-21swapper/100:00:001
125230699128,3cyclictest1486175-21kworker/u8:1+flush-259:023:21:411
125230699128,3cyclictest1460085-21apt-get22:30:121
125230699125,5cyclictest1294014-21munin-run19:50:011
125230299129,2cyclictest1487448-21sort22:55:180
125230299126,4cyclictest1534041-21irqcore23:40:160
125231299118,2cyclictest1517192-21idleruntime-cro23:25:003
125231299118,2cyclictest1289093-21kworker/u8:0+flush-259:020:05:313
125231299118,1cyclictest0-21swapper/323:40:173
125231299117,2cyclictest1543407-21latency_hist23:50:003
125231299117,2cyclictest1265167-21kthreadcore19:20:183
125231299111,3cyclictest1350789-21latency_hist20:45:003
125231299111,2cyclictest1324990-21latency_hist20:20:013
125230899119,1cyclictest0-21swapper/221:05:002
125230899118,2cyclictest1418780-21cpuspeed_turbos21:50:132
125230699118,2cyclictest1559852-21fschecks_count00:05:151
125231299106,2cyclictest0-21swapper/320:30:143
125230899107,2cyclictest14967052sleep223:05:122
125230899106,3cyclictest335557-21systemd-journal22:39:102
125230699108,1cyclictest1497754-21kthreadcore23:05:171
125230699108,1cyclictest0-21swapper/120:55:121
125230699107,2cyclictest0-21swapper/122:05:221
125230699104,4cyclictest1387269-21apt-get21:20:131
125230699104,4cyclictest1387269-21apt-get21:20:131
12523069997,1cyclictest311ktimers/120:35:001
12523069997,1cyclictest0-21swapper/121:50:171
12523069995,3cyclictest1564274-21kworker/u8:2+flush-259:000:21:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional