You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 14:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sat Aug 22, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
835101994946,2cyclictest944965-21kworker/u8:1+events_unbound22:40:223
835090994845,2cyclictest1060348-21kworker/u8:2+flush-259:023:20:000
835090994845,2cyclictest1060348-21kworker/u8:2+flush-259:023:20:000
835090994438,4cyclictest509-21rs:main0
835101994138,2cyclictest903240-21kworker/u8:0+events_unbound20:20:113
835101994037,2cyclictest1060348-21kworker/u8:2+events_unbound23:10:243
835097994036,3cyclictest1086250-21kworker/u8:1+flush-259:023:55:012
835090994036,3cyclictest1024423-21kworker/u8:3+flush-259:022:45:240
835101993936,2cyclictest871950-21kworker/u8:4+events_unbound20:10:163
835101993936,2cyclictest1024423-21kworker/u8:3+flush-259:022:50:233
835093993833,3cyclictest1086674-21cat23:10:001
835093993732,4cyclictest835300-21apt-get19:10:111
835090993629,5cyclictest950121-21latency_hist21:00:010
835090993629,5cyclictest950121-21latency_hist21:00:000
835101993533,2cyclictest871950-21kworker/u8:4+flush-259:020:35:203
835101993533,2cyclictest829916-21kworker/u8:2+flush-259:020:05:203
835101993532,2cyclictest871950-21kworker/u8:4+events_unbound19:50:133
835093993530,4cyclictest1112817-21apt-get23:35:121
835101993432,2cyclictest1060348-21kworker/u8:2+events_unbound23:09:573
835101993431,2cyclictest954881-21kworker/u8:2+events_unbound21:10:213
835101993431,2cyclictest944965-21kworker/u8:1+events_unbound22:03:553
835101993431,2cyclictest893079-21kworker/u8:3+events_unbound21:08:573
835101993428,4cyclictest892419-21latency_hist20:05:013
835093993430,3cyclictest335557-21systemd-journal19:58:551
835090993426,5cyclictest335557-21systemd-journal20:15:000
835101993331,2cyclictest944965-21kworker/u8:1+events_unbound21:20:143
835101993331,2cyclictest871919-21kworker/u8:0+events_unbound19:59:563
835101993331,1cyclictest1086250-21kworker/u8:1+events_unbound23:20:233
835101993330,2cyclictest944965-21kworker/u8:1+events_unbound21:29:573
835101993330,2cyclictest903240-21kworker/u8:0+flush-259:020:50:243
835101993329,3cyclictest954881-21kworker/u8:2+events_unbound21:39:553
835101993329,3cyclictest1060348-21kworker/u8:2+events_unbound00:13:213
835101993328,2cyclictest1060348-21kworker/u8:2+events_unbound23:15:153
835101993328,2cyclictest1060348-21kworker/u8:2+events_unbound23:15:143
835097993327,4cyclictest1018854-21/usr/sbin/munin22:05:152
835093993328,3cyclictest966050-21latency_hist21:15:011
835101993229,2cyclictest903240-21kworker/u8:0+events_unbound20:58:563
835101993229,2cyclictest903240-21kworker/u8:0+events_unbound20:58:563
835101993229,2cyclictest1133256-21kworker/u8:0+events_unbound00:35:193
835101993229,2cyclictest1044916-21kworker/u8:0+events_unbound22:56:563
835101993229,2cyclictest1018591-21kworker/u8:2+events_unbound22:10:193
835090993228,3cyclictest944965-21kworker/u8:1+flush-259:021:25:230
835101993128,2cyclictest903240-21kworker/u8:0+events_unbound21:01:003
835101993127,3cyclictest944965-21kworker/u8:1+events_unbound22:16:573
835097993128,2cyclictest986980-21kworker/u8:0+flush-259:021:40:232
835097993126,3cyclictest944965-21kworker/u8:1+flush-259:021:30:212
835097993126,3cyclictest829915-21kworker/u8:1+flush-259:019:20:152
835093993127,3cyclictest335557-21systemd-journal23:01:251
835090993126,3cyclictest986982-21gpgv21:35:000
835101993027,2cyclictest954881-21kworker/u8:2+flush-259:021:15:163
835101993027,2cyclictest944965-21kworker/u8:1+events_unbound22:35:143
835101993027,2cyclictest944965-21kworker/u8:1+events_unbound22:06:123
835101993027,2cyclictest829916-21kworker/u8:2+events_unbound20:15:233
835101993027,2cyclictest829916-21kworker/u8:2+events_unbound19:38:563
835101993027,2cyclictest829916-21kworker/u8:2+events_unbound19:26:563
835101993027,2cyclictest1060348-21kworker/u8:2+events_unbound00:00:123
835101993027,2cyclictest1024423-21kworker/u8:3+events_unbound22:45:203
835101993026,3cyclictest903240-21kworker/u8:0+flush-259:020:45:253
835097993026,2cyclictest1060348-21kworker/u8:2+flush-259:000:20:182
835097993023,5cyclictest902318-21ntpq20:10:192
835093993026,3cyclictest1123192-21apt-get23:45:101
835090993024,4cyclictest335557-21systemd-journal19:25:000
835101992926,2cyclictest944965-21kworker/u8:1+events_unbound21:46:573
835101992926,2cyclictest871950-21kworker/u8:4+events_unbound19:45:233
835101992926,2cyclictest829916-21kworker/u8:2+events_unbound19:15:253
835101992926,2cyclictest1133256-21kworker/u8:0+events_unbound00:19:553
835101992926,2cyclictest1086250-21kworker/u8:1+events_unbound23:35:563
835097992923,4cyclictest1097001-21latency_hist23:20:012
835097992923,4cyclictest1097001-21latency_hist23:20:002
835101992825,2cyclictest829916-21kworker/u8:2+events_unbound19:20:553
835101992825,2cyclictest1086250-21kworker/u8:1+events_unbound23:50:553
835101992825,2cyclictest1060348-21kworker/u8:2+events_unbound23:01:563
835097992821,5cyclictest1007400-21ntpq21:50:212
835093992822,4cyclictest1132354-21ntpq23:50:211
835090992825,2cyclictest944965-21kworker/u8:1+events_unbound22:00:150
835090992825,2cyclictest871950-21kworker/u8:4+flush-259:020:05:560
835090992822,4cyclictest975479-21ntpq21:20:200
835101992724,2cyclictest986980-21kworker/u8:0+events_unbound21:40:563
835101992724,2cyclictest866095-21kworker/u8:3+events_unbound19:40:123
835097992716,9cyclictest944965-21kworker/u8:1+flush-259:021:30:012
835093992723,3cyclictest1024333-21gpgv22:10:011
835093992721,4cyclictest1044868-21latency_hist22:30:001
835090992724,2cyclictest490-21dbus-daemon19:30:000
835090992723,3cyclictest866751-21apt-get19:40:110
835090992723,3cyclictest1024423-21kworker/u8:3+events_unbound22:21:550
835090992721,4cyclictest335557-21systemd-journal22:35:000
835101992624,2cyclictest1086250-21kworker/u8:1+events_unbound23:32:563
835101992623,2cyclictest1060348-21kworker/u8:2+events_unbound00:33:303
835101992622,3cyclictest819724-21kworker/u8:0+events_unbound19:10:023
835090992623,2cyclictest1086250-21kworker/u8:1+flush-259:023:20:250
835090992623,2cyclictest1024423-21kworker/u8:3+events_unbound22:52:560
835090992622,2cyclictest1070716-21kworker/u8:4+flush-259:023:00:210
835101992522,2cyclictest1133256-21kworker/u8:0+events_unbound00:25:213
835097992519,4cyclictest1107352-21latency_hist23:30:012
835097992519,4cyclictest1102174-21latency_hist23:25:002
835093992520,4cyclictest335557-21systemd-journal23:57:221
835090992522,2cyclictest986980-21kworker/u8:0+events_unbound21:56:550
835090992521,3cyclictest850595-21kworker/u8:0+flush-259:019:35:000
835101992421,2cyclictest871950-21kworker/u8:4+events_unbound20:25:233
835097992419,3cyclictest934207-21basename20:45:002
835097992417,4cyclictest1049165-21ntpq22:30:202
835097992416,6cyclictest1127216-21ntpq23:45:192
835093992419,4cyclictest1159352-21apt-get00:20:121
835090992420,3cyclictest903240-21kworker/u8:0+events_unbound20:50:140
835090992418,4cyclictest1168503-21ntpq00:25:200
835097992318,3cyclictest829916-21kworker/u8:2+flush-259:019:35:262
835097992316,4cyclictest335557-21systemd-journal21:05:552
835093992319,3cyclictest829916-21kworker/u8:2+flush-259:019:20:001
835090992320,2cyclictest954881-21kworker/u8:2+events_unbound21:35:120
835101992221,1cyclictest986980-21kworker/u8:0+events_unbound21:50:263
835101992219,2cyclictest1024423-21kworker/u8:3+events_unbound22:30:213
835097992219,2cyclictest944965-21kworker/u8:1+flush-259:021:00:142
835097992218,3cyclictest1024423-21kworker/u8:3+flush-259:022:50:252
835093992217,4cyclictest918967-21apt-get20:30:121
83509399220,20cyclictest850592-21true19:25:001
835090992218,3cyclictest871919-21kworker/u8:0+flush-259:019:55:250
835090992218,3cyclictest1133256-21kworker/u8:0+events_unbound00:18:560
835101992118,2cyclictest871950-21kworker/u8:4+events_unbound20:40:213
835090992119,2cyclictest1070716-21kworker/u8:4+events_unbound23:10:150
835090992118,3cyclictest944965-21kworker/u8:1+events_unbound21:00:160
835090992118,2cyclictest829916-21kworker/u8:2+flush-259:019:35:120
835090992118,2cyclictest1024423-21kworker/u8:3+flush-259:022:25:200
835090992115,4cyclictest960429-21apt-get21:10:010
835101992018,2cyclictest1060348-21kworker/u8:2+events_unbound23:40:233
835101992015,3cyclictest1034789-21apt-get22:20:113
835097992014,4cyclictest335557-21systemd-journal00:35:552
835097992013,5cyclictest939783-21latency_hist20:50:002
835090992016,3cyclictest893079-21kworker/u8:3+events_unbound20:34:560
835090992016,3cyclictest1102225-21kworker/u8:0+events_unbound23:35:230
835101991917,2cyclictest1133256-21kworker/u8:0+events_unbound00:05:193
835101991913,2cyclictest944965-21kworker/u8:1+events_unbound21:30:303
83509799198,8cyclictest954881-21kworker/u8:2+flush-259:021:20:002
835097991915,3cyclictest1086221-21apt-get23:10:002
835093991916,2cyclictest954881-21kworker/u8:2+events_unbound21:09:551
835093991916,2cyclictest914223-21irqcore20:25:151
835093991915,3cyclictest1044916-21kworker/u8:0+flush-259:022:55:141
835093991914,3cyclictest892939-21base6420:05:011
835093991913,5cyclictest970376-21ntpq21:15:231
835093991913,4cyclictest335557-21systemd-journal00:14:551
835093991913,4cyclictest335557-21systemd-journal00:05:561
835090991916,2cyclictest1060348-21kworker/u8:2+events_unbound23:40:120
835090991916,2cyclictest1060348-21kworker/u8:2+events_unbound00:35:200
835090991916,2cyclictest1060348-21kworker/u8:2+events_unbound00:10:120
835090991915,3cyclictest1086250-21kworker/u8:1+events_unbound23:46:300
835101991815,2cyclictest986980-21kworker/u8:0+events_unbound21:55:163
83509799182,10cyclictest887246-21munin-run20:00:012
835097991815,2cyclictest1024423-21kworker/u8:3+flush-259:022:20:222
835097991814,3cyclictest1018591-21kworker/u8:2+flush-259:022:15:252
835097991813,4cyclictest1086221-21apt-get23:10:002
835093991814,2cyclictest0-21swapper/120:05:011
835090991816,1cyclictest960544-21gpgv21:10:000
835090991815,2cyclictest829916-21kworker/u8:2+events_unbound19:15:170
835090991814,3cyclictest986980-21kworker/u8:0+events_unbound21:50:210
835090991814,3cyclictest986980-21kworker/u8:0+events_unbound21:45:180
835090991814,3cyclictest871950-21kworker/u8:4+events_unbound20:15:270
835090991814,3cyclictest1133256-21kworker/u8:0+events_unbound00:08:570
835090991814,3cyclictest1024423-21kworker/u8:3+flush-259:022:10:150
835101991714,2cyclictest893079-21kworker/u8:3+events_unbound20:34:363
835097991714,2cyclictest894127-21kthreadcore20:05:182
835097991713,3cyclictest998046-21base6421:45:012
835097991713,3cyclictest954881-21kworker/u8:2+flush-259:021:35:252
835097991711,4cyclictest1153909-21latency_hist00:15:012
835093991714,1cyclictest191rcu_preempt21:26:041
835093991713,3cyclictest1023774-21apt-get22:10:011
835090991714,2cyclictest871919-21kworker/u8:0+events_unbound20:00:180
835090991714,2cyclictest60350irq/132-enp0s29f1:rx-020:45:020
835090991714,2cyclictest1133256-21kworker/u8:0+events_unbound00:03:570
835090991713,3cyclictest1133256-21kworker/u8:0+events_unbound00:23:560
835090991713,3cyclictest1060348-21kworker/u8:2+flush-259:023:55:250
835090991711,4cyclictest934312-21cp20:45:000
835097991613,2cyclictest1018618-21turbostat.cron22:05:002
835097991612,2cyclictest1122937-21sh23:45:012
835097991611,4cyclictest1044916-21kworker/u8:0+flush-259:022:40:002
835097991611,3cyclictest829916-21kworker/u8:2+flush-259:019:45:242
835097991611,3cyclictest829916-21kworker/u8:2+flush-259:019:10:232
83509399169,5cyclictest882057-21latency_hist19:55:011
83509399161,4cyclictest1037238-21grep22:20:191
835093991611,3cyclictest997522-21sh21:45:011
83509399160,4cyclictest1033670-21ntpq22:15:221
835090991613,2cyclictest60350irq/132-enp0s29f1:rx-019:10:220
835101991512,2cyclictest1117752-21kworker/u8:3+events_unbound23:49:273
835101991512,2cyclictest1060348-21kworker/u8:2+flush-259:023:55:443
83509799159,3cyclictest335557-21systemd-journal23:30:552
835097991512,2cyclictest1075876-21cron22:59:592
835097991512,2cyclictest1061595-21tr22:45:162
835097991511,3cyclictest949189-21ntp_kernel_err20:55:202
835097991511,3cyclictest949189-21ntp_kernel_err20:55:202
83509399158,1cyclictest191rcu_preempt00:30:231
835093991511,3cyclictest986980-21kworker/u8:0+flush-259:021:55:151
835093991510,4cyclictest986980-21kworker/u8:0+flush-259:021:55:001
835090991513,1cyclictest60350irq/132-enp0s29f1:rx-020:35:210
835090991512,2cyclictest986980-21kworker/u8:0+events_unbound22:08:550
835090991512,2cyclictest60350irq/132-enp0s29f1:rx-023:05:180
835090991512,2cyclictest60350irq/132-enp0s29f1:rx-022:40:210
835090991512,2cyclictest60350irq/132-enp0s29f1:rx-021:40:150
835090991512,2cyclictest60350irq/132-enp0s29f1:rx-019:45:110
835090991512,2cyclictest1044916-21kworker/u8:0+flush-259:022:55:220
835090991511,3cyclictest1086250-21kworker/u8:1+events_unbound23:50:220
835090991511,3cyclictest1018591-21kworker/u8:2+flush-259:022:15:250
835090991511,1cyclictest60350irq/132-enp0s29f1:rx-019:55:000
835101991411,2cyclictest850595-21kworker/u8:0+flush-259:019:32:003
835097991411,2cyclictest1174192-21unixbench_singl00:30:252
835097991411,2cyclictest0-21swapper/219:30:202
835097991410,2cyclictest1117735-21sh23:40:002
83509399141,4cyclictest32-21ksoftirqd/100:35:221
83509399141,3cyclictest856879-21sed19:30:171
835093991411,1cyclictest191rcu_preempt22:50:401
835090991412,1cyclictest60350irq/132-enp0s29f1:rx-020:25:190
83510199136,2cyclictest191rcu_preempt00:20:173
835101991310,2cyclictest1060348-21kworker/u8:2+flush-259:023:26:013
83509799139,3cyclictest944965-21kworker/u8:1+flush-259:021:11:062
83509799136,4cyclictest908381-21cron20:20:002
83509799135,6cyclictest335557-21systemd-journal20:05:012
835097991310,2cyclictest1133497-21apt-get23:55:112
83509799130,8cyclictest1060318-21munin-run22:44:592
83509399133,2cyclictest32-21ksoftirqd/120:15:151
83509399132,3cyclictest32-21ksoftirqd/119:25:121
83509399132,2cyclictest991470-21ntpq21:35:211
835093991311,1cyclictest0-21swapper/121:35:001
835093991310,2cyclictest908661-21apt-get20:20:131
83509399130,3cyclictest1098136-21cut23:20:171
83509399130,2cyclictest945205-21apt-get20:55:111
83509399130,2cyclictest945205-21apt-get20:55:111
83509099138,4cyclictest871950-21kworker/u8:4+flush-259:020:20:250
835090991311,1cyclictest60350irq/132-enp0s29f1:rx-021:20:000
835090991310,2cyclictest60350irq/132-enp0s29f1:rx-023:25:100
83510199125,1cyclictest191rcu_preempt22:25:183
83509799129,2cyclictest0-21swapper/200:30:002
83509799128,3cyclictest1024629-21fschecks_count22:10:142
83509399121,6cyclictest1002379-21/usr/sbin/munin21:45:221
83509399121,3cyclictest32-21ksoftirqd/123:25:151
83509399121,2cyclictest32-21ksoftirqd/123:30:201
835090991210,1cyclictest60350irq/132-enp0s29f1:rx-022:35:130
835090991210,1cyclictest60350irq/132-enp0s29f1:rx-000:30:160
83509799114,5cyclictest1013459-21latency_hist22:00:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional