You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 13:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Jun 12, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
764432994943,4cyclictest816037-21apt-get19:56:200
764441994236,4cyclictest335557-21systemd-journal20:20:012
764445994135,4cyclictest846944-21ntpq20:25:193
764432994135,4cyclictest1076097-21ntpq00:05:220
764437994033,5cyclictest977804-21ntpq22:30:221
764445993933,4cyclictest1097585-21latency_hist00:30:013
764437993932,5cyclictest1054959-21ntpq23:45:211
764441993833,4cyclictest335557-21systemd-journal23:52:252
764437993832,4cyclictest853234-21/usr/sbin/munin20:35:141
764432993832,4cyclictest962790-21latency_hist22:20:010
764432993832,4cyclictest962790-21latency_hist22:20:010
764445993731,4cyclictest335557-21systemd-journal23:57:473
764441993731,4cyclictest1029275-21ntpq23:20:222
764441993730,5cyclictest936549-21latency_hist21:55:012
764432993734,2cyclictest879320-21kworker/u8:0+flush-259:021:00:160
764432993633,2cyclictest931631-21apt-get21:50:110
764437993431,2cyclictest759444-21kworker/u8:1+flush-259:019:55:161
764437993327,4cyclictest890289-21apt-get21:10:111
764441993227,3cyclictest842342-21gpgv20:25:002
764437993228,3cyclictest1024736-21kworker/u8:1+flush-259:023:40:011
764432993229,2cyclictest968553-21kworker/u8:3+flush-259:022:35:250
764432993228,3cyclictest1092654-21apt-get00:25:100
764432993228,3cyclictest1050596-21kworker/u8:2+flush-259:000:00:250
764445993126,3cyclictest509-21rs:main3
764441993126,4cyclictest335557-21systemd-journal00:03:252
764441993125,4cyclictest973508-21latency_hist22:30:002
764437993025,4cyclictest968462-21gpgv22:25:011
764437993024,5cyclictest831031-21ntpq20:10:211
764432993024,4cyclictest968507-21cat22:25:010
764445992925,3cyclictest837277-21/usr/sbin/munin20:20:183
764445992925,3cyclictest821578-21kworker/u8:2+flush-259:020:05:203
764445992922,5cyclictest335557-21systemd-journal22:50:003
764441992924,3cyclictest759444-21kworker/u8:1+flush-259:019:55:002
764437992925,3cyclictest931390-21kworker/u8:1+flush-259:021:55:211
764437992925,3cyclictest821578-21kworker/u8:2+flush-259:020:55:151
764432992925,3cyclictest873806-21gpgv20:55:010
764445992825,2cyclictest826973-21kworker/u8:3+flush-259:020:40:003
764445992824,3cyclictest774665-21kworker/u8:0+flush-259:019:50:203
764445992823,4cyclictest1077201-21apt-get00:10:113
764441992823,4cyclictest1035530-21/usr/sbin/munin23:30:182
764437992824,3cyclictest759444-21kworker/u8:1+flush-259:019:10:231
764432992823,4cyclictest737550-21kworker/u8:2+events_unbound19:25:200
764432992823,3cyclictest963021-21/usr/sbin/munin22:20:130
764432992724,2cyclictest759444-21kworker/u8:1+events_unbound19:30:200
764432992721,5cyclictest768608-21ntpq19:10:190
764445992622,3cyclictest842260-21kworker/u8:4+flush-259:021:05:003
764445992622,3cyclictest826973-21kworker/u8:3+flush-259:020:10:253
764441992622,3cyclictest335557-21systemd-journal23:41:262
764441992622,3cyclictest1040467-21kworker/u8:3+flush-259:023:45:242
764441992621,4cyclictest1107914-21latency_hist00:40:012
764437992622,3cyclictest1050596-21kworker/u8:2+flush-259:000:14:591
764437992621,3cyclictest915927-21latency_hist21:35:011
764432992622,3cyclictest774665-21kworker/u8:0+events_unbound19:50:190
764432992621,3cyclictest509-21rs:main0
764445992521,3cyclictest957821-21cat22:15:003
764445992521,3cyclictest957821-21cat22:15:003
764445992521,3cyclictest879320-21kworker/u8:0+flush-259:021:05:203
764445992521,3cyclictest821578-21kworker/u8:2+flush-259:020:45:203
764445992520,4cyclictest967906-21apt-get22:25:003
764437992521,3cyclictest1050596-21kworker/u8:2+flush-259:000:35:161
764437992519,4cyclictest879272-21apt-get21:00:011
764441992420,3cyclictest905792-21kworker/u8:2+flush-259:021:45:232
764441992420,3cyclictest774665-21kworker/u8:0+events_unbound19:55:202
764437992420,3cyclictest774665-21kworker/u8:0+flush-259:019:50:231
764437992420,3cyclictest335557-21systemd-journal00:21:251
764437992418,4cyclictest1061003-21latency_hist23:55:001
764432992418,5cyclictest1060096-21ntpq23:50:200
764445992320,2cyclictest759444-21kworker/u8:1+events_unbound19:35:223
764445992319,3cyclictest1050596-21kworker/u8:2+flush-259:000:35:003
764441992320,2cyclictest759444-21kworker/u8:1+flush-259:019:35:252
764437992318,4cyclictest1045858-21apt-get23:40:131
764437992317,4cyclictest826742-21latency_hist20:10:001
764432992319,3cyclictest994382-21kworker/u8:4+flush-259:023:05:160
764432992318,4cyclictest335557-21systemd-journal21:49:200
764432992317,4cyclictest335557-21systemd-journal23:20:010
764432992316,5cyclictest335557-21systemd-journal22:15:000
764432992316,5cyclictest335557-21systemd-journal22:14:590
764445992218,3cyclictest994382-21kworker/u8:4+flush-259:022:55:263
764445992218,3cyclictest921299-21kworker/u8:3+events_unbound21:40:223
764445992218,3cyclictest335557-21systemd-journal21:11:213
764445992217,4cyclictest1060996-21apt-get23:55:003
764441992217,4cyclictest335557-21systemd-journal19:25:002
764437992218,3cyclictest1020161-21apt-get23:15:111
764432992218,3cyclictest905792-21kworker/u8:2+flush-259:022:00:160
764432992216,4cyclictest911170-21diskstats21:30:130
764445992118,2cyclictest931597-21kworker/u8:4+events_unbound21:55:233
764445992118,2cyclictest879320-21kworker/u8:0+events_unbound22:10:233
764445992118,2cyclictest879320-21kworker/u8:0+events_unbound22:10:223
764445992117,3cyclictest759444-21kworker/u8:1+flush-259:019:20:153
764445992116,4cyclictest335557-21systemd-journal23:24:243
764445992115,3cyclictest335557-21systemd-journal23:59:593
764441992118,2cyclictest335557-21systemd-journal20:42:132
764441992117,3cyclictest1066587-21cp00:00:002
764441992117,2cyclictest957415-21gpgv22:15:012
764441992117,2cyclictest957415-21gpgv22:15:012
764441992116,4cyclictest335557-21systemd-journal20:50:002
764441992115,4cyclictest769494-21latency_hist19:15:002
764437992117,3cyclictest759444-21kworker/u8:1+flush-259:019:20:161
764437992114,5cyclictest1040460-21latency_hist23:35:011
764445992017,3cyclictest1024736-21kworker/u8:1+events_unbound23:25:263
764445992016,3cyclictest1024736-21kworker/u8:1+flush-259:023:35:163
764445992016,3cyclictest1014763-21kworker/u8:2+events_unbound23:30:233
764441992017,2cyclictest968553-21kworker/u8:3+flush-259:022:40:262
764437992016,3cyclictest931390-21kworker/u8:1+flush-259:021:50:241
764437992016,3cyclictest335557-21systemd-journal20:05:001
764445991916,2cyclictest2971-21cron21:49:593
764445991915,3cyclictest737550-21kworker/u8:2+events_unbound19:25:213
764445991915,3cyclictest1040467-21kworker/u8:3+events_unbound00:15:173
764445991913,5cyclictest335557-21systemd-journal19:35:003
76444599191,17cyclictest1-21systemd20:56:213
764441991916,2cyclictest821578-21kworker/u8:2+flush-259:020:10:202
764441991915,3cyclictest968015-21gpgv22:25:012
764432991916,2cyclictest921075-21turbostat21:39:590
764432991916,2cyclictest826973-21kworker/u8:3+flush-259:020:17:110
764432991915,3cyclictest994382-21kworker/u8:4+flush-259:022:55:010
764432991915,3cyclictest826973-21kworker/u8:3+events_unbound21:15:250
764432991915,3cyclictest795260-21kworker/u8:3+flush-259:020:00:240
764432991913,4cyclictest1055873-21latency_hist23:50:010
764445991815,2cyclictest981244-21kthreadcore22:35:193
764445991814,3cyclictest826973-21kworker/u8:3+events_unbound20:15:243
764445991813,4cyclictest988112-21ntpq22:40:223
764445991810,6cyclictest978688-21latency_hist22:35:013
764441991814,3cyclictest826973-21kworker/u8:3+flush-259:021:05:142
764437991814,3cyclictest957196-21latency_hist22:15:011
764437991814,3cyclictest957196-21latency_hist22:15:001
764437991813,4cyclictest846935-21ntpq20:25:201
764437991813,4cyclictest335557-21systemd-journal23:12:261
764432991815,2cyclictest1024736-21kworker/u8:1+flush-259:023:25:150
764432991815,1cyclictest0-21swapper/019:19:590
764432991814,3cyclictest826973-21kworker/u8:3+events_unbound21:20:200
764432991814,3cyclictest795260-21kworker/u8:3+flush-259:019:50:000
764445991711,5cyclictest335557-21systemd-journal19:45:003
76444599171,14cyclictest1-21systemd00:10:003
764445991710,5cyclictest764339-21latency_hist19:10:023
76444199172,8cyclictest1082106-21munin-run00:15:002
764441991714,2cyclictest931597-21kworker/u8:4+flush-259:022:00:262
764441991714,2cyclictest1092431-21kworker/u8:4+flush-259:000:30:002
764441991711,4cyclictest1030392-21/usr/sbin/munin23:25:142
764437991714,2cyclictest0-21swapper/123:05:001
764432991713,3cyclictest879519-21cat21:00:000
764432991712,3cyclictest1097821-21/usr/sbin/munin00:30:140
764445991612,3cyclictest842260-21kworker/u8:4+flush-259:021:25:173
764445991612,3cyclictest721905-21kworker/u8:3+flush-259:019:15:163
764445991612,3cyclictest1045833-21/usr/sbin/munin23:40:163
764445991612,3cyclictest1040467-21kworker/u8:3+events_unbound23:45:173
764445991612,2cyclictest0-21swapper/321:40:003
764441991612,3cyclictest842887-21munin-node20:25:102
764441991611,4cyclictest335557-21systemd-journal22:37:242
764437991613,2cyclictest837271-21kworker/u8:0+flush-259:020:20:251
764437991613,2cyclictest1086780-21unixbench_multi00:15:251
764437991612,3cyclictest905792-21kworker/u8:2+flush-259:022:20:251
764437991612,3cyclictest905792-21kworker/u8:2+flush-259:022:09:591
764437991612,3cyclictest335557-21systemd-journal19:17:001
764437991611,4cyclictest994417-21apt-get22:50:121
764432991614,1cyclictest60350irq/132-enp0s29f1:rx-023:35:240
764432991613,2cyclictest60350irq/132-enp0s29f1:rx-023:40:200
764432991613,2cyclictest60350irq/132-enp0s29f1:rx-020:34:360
764432991612,3cyclictest1004711-21/usr/sbin/munin23:00:180
76444599159,4cyclictest879320-21kworker/u8:0+flush-259:023:15:013
764445991511,3cyclictest994382-21kworker/u8:4+flush-259:023:10:003
764445991511,3cyclictest879320-21kworker/u8:0+events_unbound21:30:173
764445991511,2cyclictest0-21swapper/320:55:003
764441991512,2cyclictest785202-21apt-get19:30:122
764441991512,2cyclictest1072461-21irqcore00:05:172
764441991511,3cyclictest905792-21kworker/u8:2+flush-259:022:20:002
764441991511,3cyclictest905792-21kworker/u8:2+flush-259:022:19:592
764441991511,3cyclictest879320-21kworker/u8:0+flush-259:021:38:522
764441991511,2cyclictest1-21systemd19:45:002
764437991513,1cyclictest1024736-21kworker/u8:1-ext4-rsv-conversion23:30:011
764437991512,2cyclictest826973-21kworker/u8:3+events_unbound20:15:171
76443299157,5cyclictest994154-21sh22:49:590
764432991513,1cyclictest60350irq/132-enp0s29f1:rx-023:30:150
764432991513,1cyclictest60350irq/132-enp0s29f1:rx-020:47:470
764432991513,1cyclictest60350irq/132-enp0s29f1:rx-000:35:090
764432991512,2cyclictest922347-21kthreadcore21:40:180
764432991511,3cyclictest60350irq/132-enp0s29f1:rx-021:55:120
76444599148,4cyclictest842260-21kworker/u8:4+events_unbound20:40:163
764445991410,3cyclictest759444-21kworker/u8:1+events_unbound19:55:223
764445991410,2cyclictest0-21swapper/322:10:003
76444199142,6cyclictest941727-21turbostat21:59:592
764441991411,2cyclictest921299-21kworker/u8:3+flush-259:021:40:162
764441991411,2cyclictest795260-21kworker/u8:3+flush-259:020:00:172
764437991412,1cyclictest0-21swapper/122:00:211
764437991411,2cyclictest879320-21kworker/u8:0+flush-259:021:20:261
764437991411,2cyclictest1024736-21kworker/u8:1+flush-259:023:22:461
764437991410,3cyclictest1050596-21kworker/u8:2+flush-259:000:05:261
76443299149,4cyclictest879320-21kworker/u8:0+events_unbound21:25:220
764432991413,1cyclictest60350irq/132-enp0s29f1:rx-022:55:260
764432991412,1cyclictest60350irq/132-enp0s29f1:rx-023:55:230
764432991412,1cyclictest60350irq/132-enp0s29f1:rx-020:25:220
764432991411,2cyclictest60350irq/132-enp0s29f1:rx-020:35:170
764432991411,2cyclictest60350irq/132-enp0s29f1:rx-020:10:230
764432991411,2cyclictest60350irq/132-enp0s29f1:rx-019:40:120
764432991411,2cyclictest1084664-21kthreadcore00:15:180
764432991411,1cyclictest0-21swapper/023:15:010
76444599139,3cyclictest879320-21kworker/u8:0+flush-259:022:50:263
764441991310,2cyclictest842260-21kworker/u8:4+flush-259:020:37:162
764441991310,2cyclictest826321-21unixbench_singl20:05:252
764441991310,2cyclictest0-21swapper/222:54:592
764432991312,1cyclictest60350irq/132-enp0s29f1:rx-023:24:490
764432991312,1cyclictest60350irq/132-enp0s29f1:rx-021:13:470
764432991311,1cyclictest60350irq/132-enp0s29f1:rx-022:05:190
764432991311,1cyclictest60350irq/132-enp0s29f1:rx-019:21:550
764432991310,2cyclictest879320-21kworker/u8:0+flush-259:021:05:060
76444599128,2cyclictest0-21swapper/322:20:183
76444199129,2cyclictest968553-21kworker/u8:3+flush-259:022:48:562
76444199129,2cyclictest879320-21kworker/u8:0+flush-259:021:30:212
76444199129,2cyclictest737550-21kworker/u8:2+flush-259:019:30:002
76444199128,3cyclictest951069-21grep22:05:192
76444199128,3cyclictest335557-21systemd-journal23:39:562
76443799129,3cyclictest879320-21kworker/u8:0+flush-259:021:37:251
76443799129,2cyclictest921408-21cpuspeed_turbos21:40:121
76443799129,2cyclictest1097912-21cpuspeed_turbos00:30:131
76443799129,2cyclictest1097147-21unixbench_singl00:25:231
76443799129,2cyclictest1050596-21kworker/u8:2+flush-259:000:05:001
76443799128,3cyclictest952265-21kworker/u8:4+flush-259:022:15:261
76443799128,3cyclictest952265-21kworker/u8:4+flush-259:022:15:251
76443799128,3cyclictest759444-21kworker/u8:1+flush-259:019:30:301
764437991210,1cyclictest0-21swapper/119:30:001
76443299129,2cyclictest500-21systemd-logind20:45:000
764432991211,1cyclictest60350irq/132-enp0s29f1:rx-022:30:200
764432991211,1cyclictest60350irq/132-enp0s29f1:rx-000:22:050
764432991211,1cyclictest60350irq/132-enp0s29f1:rx-000:10:230
76444599119,1cyclictest0-21swapper/320:30:233
76444599118,2cyclictest0-21swapper/321:20:253
76444199118,2cyclictest826973-21kworker/u8:3+events_unbound20:30:202
76443799118,2cyclictest800921-21fschecks_time19:45:141
76443799117,3cyclictest0-21swapper/121:50:011
76444599107,2cyclictest942069-21cpuspeed_turbos22:00:143
76444199107,2cyclictest880219-21fschecks_time21:00:132
76443799106,3cyclictest821578-21kworker/u8:2+flush-259:020:49:501
7644419997,1cyclictest0-21swapper/221:20:182
7644419996,2cyclictest1097987-21cpuspeed_turbos00:30:132
7644419994,3cyclictest1084807-21tr00:15:182
7644379997,1cyclictest0-21swapper/119:35:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional