You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 20:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Sep 05, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3173976995146,4cyclictest3513661-21gpgv12:35:003
3173976995034,9cyclictest3226432-21apt-get08:00:123
3173976994336,4cyclictest3351662-21cp10:00:003
3173963994337,5cyclictest3293502-21cp09:05:010
3173963994137,2cyclictest509-21rs:main0
3173966994035,3cyclictest3481789-21apt-get12:05:131
3173976993833,3cyclictest3424464-21apt-get11:10:123
3173963993835,2cyclictest3357067-21kworker/u8:1+flush-259:010:45:250
3173966993732,3cyclictest3435264-21apt-get11:20:121
3173976993628,5cyclictest3341207-21cat09:50:013
3173966993530,4cyclictest3335757-21apt-get09:45:121
3173963993428,4cyclictest3179342-21/usr/sbin/munin07:15:140
3173966993329,3cyclictest3252222-21apt-get08:25:121
3173963993227,4cyclictest3184522-21apt-get07:20:100
3173976993124,5cyclictest335557-21systemd-journal12:25:003
3173976993124,4cyclictest3470759-21kworker/u8:1+flush-259:012:10:283
3173971993125,4cyclictest3513397-21base6412:35:002
3173963993127,3cyclictest3277858-21kworker/u8:0+events_unbound09:35:240
3173971993024,4cyclictest335557-21systemd-journal10:30:002
3173966993026,3cyclictest3470759-21kworker/u8:1+flush-259:011:55:001
3173966993024,5cyclictest3304502-21apt-key09:15:011
3173966993024,4cyclictest335557-21systemd-journal11:34:041
3173963993027,2cyclictest3215802-21kworker/u8:4+flush-259:008:20:200
3173976992922,5cyclictest3430007-21cp11:15:013
3173963992926,2cyclictest3362434-21kworker/u8:3+flush-259:010:10:200
3173976992823,4cyclictest3470759-21kworker/u8:1+flush-259:012:25:113
3173963992825,2cyclictest3231328-21kworker/u8:0+flush-259:008:05:250
3173976992721,5cyclictest3440398-21apt-get11:25:113
3173976992721,4cyclictest3513270-21base6412:35:003
3173971992722,4cyclictest509-21rs:main2
3173971992720,4cyclictest3195010-21latency_hist07:30:012
3173966992722,4cyclictest3413889-21kworker/u8:1+events_unbound11:05:191
3173966992622,3cyclictest3271727-21kworker/u8:2+flush-259:010:05:251
3173963992622,3cyclictest3216056-21apt-get07:50:100
3173963992622,3cyclictest3216056-21apt-get07:50:100
3173963992621,3cyclictest3357067-21kworker/u8:1+flush-259:010:20:180
3173976992518,5cyclictest335557-21systemd-journal07:29:593
3173963992522,2cyclictest3450704-21apt-get11:35:120
3173963992521,3cyclictest3277858-21kworker/u8:0+flush-259:010:15:240
3173963992517,5cyclictest3440129-21latency_hist11:25:010
3173966992418,4cyclictest509-21rs:main1
3173966992418,4cyclictest3351444-21apt-get10:00:021
3173963992421,2cyclictest3277858-21kworker/u8:0+events_unbound09:51:040
3173963992420,3cyclictest3424224-21kworker/u8:2+flush-259:011:45:190
3173963992420,3cyclictest3357067-21kworker/u8:1+events_unbound10:53:050
3173963992420,3cyclictest3119400-21kworker/u8:1+events_unbound07:11:040
3173976992315,7cyclictest3450438-21turbostat.cron11:35:013
3173971992319,3cyclictest3215580-21apt-get07:48:042
3173966992319,3cyclictest3319999-21kworker/u8:3+events_unbound09:35:001
3173976992215,4cyclictest3481764-21/usr/sbin/munin12:05:163
3173971992219,2cyclictest3215802-21kworker/u8:4+flush-259:008:20:262
3173966992219,2cyclictest3382787-21kworker/u8:2+flush-259:010:50:211
3173966992218,3cyclictest3445310-21kworker/u8:0+flush-259:012:10:191
3173966992218,3cyclictest3445310-21kworker/u8:0+flush-259:012:00:161
3173966992218,3cyclictest3372811-21apt-get10:20:121
3173966992218,3cyclictest3357067-21kworker/u8:1+flush-259:010:35:261
3173966992218,3cyclictest3184490-21kworker/u8:4+events_unbound07:25:231
3173963992219,2cyclictest3388049-21kworker/u8:0+flush-259:011:00:120
3173963992217,3cyclictest3408605-21kworker/u8:3+flush-259:010:55:200
3173976992115,4cyclictest3471389-21/usr/sbin/munin11:55:143
3173976992114,5cyclictest335557-21systemd-journal08:20:153
3173976992114,5cyclictest3319078-21ntpq09:25:203
3173966992118,2cyclictest3184280-21kworker/u8:0+events_unbound07:35:121
3173966992116,4cyclictest3450463-21kworker/u8:3+events_unbound12:20:261
3173966992116,4cyclictest3408956-21apt-get10:55:121
3173966992115,4cyclictest3418117-21ntpq11:00:191
3173966992115,4cyclictest3184280-21kworker/u8:0+flush-259:007:30:221
3173963992118,2cyclictest3450463-21kworker/u8:3+events_unbound11:59:040
3173963992118,2cyclictest3340682-21kworker/u8:4+flush-259:009:58:050
3173963992117,3cyclictest3486946-21apt-get12:10:140
3173963992117,3cyclictest3271727-21kworker/u8:2+flush-259:008:45:160
3173963992117,3cyclictest3205406-21kworker/u8:3+flush-259:007:45:000
317397699207,12cyclictest3267479-21cron08:40:003
317397699204,4cyclictest3179772-21ps07:15:163
3173976992016,3cyclictest3388049-21kworker/u8:0+flush-259:011:05:003
3173976992016,3cyclictest3377962-21apt-get10:25:103
3173976992014,4cyclictest335557-21systemd-journal08:32:023
3173971992017,2cyclictest3340682-21kworker/u8:4+flush-259:009:50:222
3173971992016,3cyclictest509-21rs:main2
3173971992014,4cyclictest335557-21systemd-journal12:20:002
3173966992017,2cyclictest3308686-21kworker/u8:1+events_unbound09:20:221
3173966992016,3cyclictest3119400-21kworker/u8:1+flush-259:007:50:181
3173966992016,3cyclictest3119400-21kworker/u8:1+flush-259:007:50:171
3173966992016,3cyclictest3119400-21kworker/u8:1+events_unbound07:15:241
3173966992015,4cyclictest509-21rs:main1
3173966992015,4cyclictest3221257-21apt-get07:55:131
3173966992014,4cyclictest3465920-21latency_hist11:50:001
3173963992017,2cyclictest3119400-21kworker/u8:1+flush-259:007:48:030
3173963992016,3cyclictest3424224-21kworker/u8:2+events_unbound11:40:050
3173963992016,3cyclictest3257363-21kworker/u8:3+flush-259:008:55:210
3173963992016,3cyclictest3184280-21kworker/u8:0+flush-259:007:30:010
3173963992016,2cyclictest0-21swapper/009:50:000
3173963992014,4cyclictest3466351-21diskstats11:50:130
3173963992014,4cyclictest3357067-21kworker/u8:1+flush-259:010:45:000
317397699196,2cyclictest3497075-21latency_hist12:20:003
3173976991915,3cyclictest3215802-21kworker/u8:4+flush-259:008:10:163
3173976991913,4cyclictest3351958-21base6410:00:013
3173971991915,3cyclictest3271727-21kworker/u8:2+flush-259:008:45:262
3173971991915,2cyclictest0-21swapper/207:45:002
3173971991914,4cyclictest3371657-21ntpq10:15:222
3173966991916,2cyclictest3497080-21idleruntime-cro12:20:001
3173963991916,2cyclictest3184280-21kworker/u8:0+events_unbound07:27:050
3173963991915,3cyclictest3470759-21kworker/u8:1+events_unbound12:35:180
3173963991915,3cyclictest3357067-21kworker/u8:1+events_unbound10:39:040
3173963991915,3cyclictest3241683-21kworker/u8:2+events_unbound08:26:030
317397699181,6cyclictest335480-21sshd11:05:343
3173976991815,2cyclictest3357067-21kworker/u8:1+flush-259:010:15:193
3173976991813,3cyclictest335557-21systemd-journal10:36:043
3173971991816,1cyclictest0-21swapper/209:50:002
3173971991815,2cyclictest3481514-21sh12:04:592
3173971991814,3cyclictest3184280-21kworker/u8:0+flush-259:007:30:182
3173966991815,2cyclictest3424224-21kworker/u8:2+events_unbound11:25:141
3173966991814,3cyclictest3257363-21kworker/u8:3+flush-259:009:10:161
3173966991814,3cyclictest3231583-21apt-get08:05:131
3173966991814,3cyclictest3215802-21kworker/u8:4+flush-259:008:20:141
3173966991812,4cyclictest3209720-21ntpq07:40:241
3173966991810,6cyclictest335557-21systemd-journal07:24:591
3173963991815,2cyclictest1-21systemd12:25:010
3173963991814,3cyclictest3184490-21kworker/u8:4+flush-259:007:35:250
3173963991812,4cyclictest335557-21systemd-journal10:02:030
317397699178,8cyclictest0-21swapper/307:10:203
317397699177,9cyclictest3437541-21kthreadcore11:20:183
317397699176,2cyclictest0-21swapper/307:25:013
317397699173,2cyclictest3304396-21apt-key09:15:013
317397699172,2cyclictest0-21swapper/310:45:003
317397699171,4cyclictest513-21gdbus09:00:013
317397699171,4cyclictest3331028-21cut09:40:163
317397699171,4cyclictest3330361-21systemd-run09:40:003
317397699171,4cyclictest3293312-21cron09:05:013
3173976991714,2cyclictest3257114-21cron08:30:003
317397699171,3cyclictest3272620-21cron08:45:003
3173976991712,3cyclictest509-21rs:main3
3173976991711,4cyclictest335557-21systemd-journal10:58:043
317397699170,4cyclictest3373224-21cut10:20:183
3173971991714,2cyclictest3424224-21kworker/u8:2+events_unbound11:45:002
3173971991713,3cyclictest3429424-21kworker/u8:4+flush-259:011:35:262
3173971991713,3cyclictest3308686-21kworker/u8:1+flush-259:009:20:202
3173971991713,3cyclictest3277858-21kworker/u8:0+flush-259:008:50:182
3173971991713,3cyclictest3119400-21kworker/u8:1+flush-259:007:50:102
3173971991713,3cyclictest3119400-21kworker/u8:1+flush-259:007:50:092
3173971991711,4cyclictest3304075-21apt-get09:15:012
3173971991710,5cyclictest335557-21systemd-journal09:35:002
3173966991714,2cyclictest3277858-21kworker/u8:0+flush-259:009:35:221
3173966991714,2cyclictest3257363-21kworker/u8:3+events_unbound09:00:181
3173966991714,2cyclictest3231328-21kworker/u8:0+flush-259:008:10:231
3173966991713,3cyclictest3486695-21kworker/u8:2+events_unbound12:30:231
3173966991713,3cyclictest3383143-21apt-get10:30:151
3173966991713,3cyclictest3271727-21kworker/u8:2+flush-259:009:55:151
3173966991712,3cyclictest335557-21systemd-journal12:37:041
3173966991711,4cyclictest3174170-21apt-get07:10:131
3173963991715,2cyclictest3450463-21kworker/u8:3+flush-259:012:25:270
3173963991714,2cyclictest3277858-21kworker/u8:0+events_unbound08:50:220
3173963991714,1cyclictest0-21swapper/011:10:000
3173963991713,3cyclictest3413889-21kworker/u8:1+events_unbound11:10:180
3173963991713,3cyclictest3277858-21kworker/u8:0+flush-259:010:29:030
3173963991713,3cyclictest3271727-21kworker/u8:2+events_unbound09:30:160
3173963991713,3cyclictest3257363-21kworker/u8:3+flush-259:009:15:050
3173963991713,3cyclictest3231328-21kworker/u8:0+events_unbound08:11:030
3173963991713,3cyclictest3215802-21kworker/u8:4+flush-259:007:55:040
317397699161,4cyclictest3320483-21fschecks_time09:30:163
317397699161,4cyclictest3199223-21grep07:30:213
317397699161,3cyclictest513-21gdbus10:15:003
317397699161,3cyclictest335557-21systemd-journal07:55:003
317397699161,3cyclictest335557-21systemd-journal07:55:003
317397699160,5cyclictest3236510-21systemd-run08:10:013
317397699160,4cyclictest3455593-21awk11:40:003
3173971991613,2cyclictest3424224-21kworker/u8:2+flush-259:011:25:242
3173971991613,2cyclictest3283278-21apt-get08:55:112
3173971991610,4cyclictest3465011-21ntpq11:45:212
3173971991610,4cyclictest335557-21systemd-journal08:10:002
317397199160,2cyclictest2971-21cron12:00:002
3173966991614,1cyclictest3277858-21kworker/u8:0+events_unbound09:25:241
3173966991612,3cyclictest3362434-21kworker/u8:3+flush-259:010:10:251
3173966991610,4cyclictest335557-21systemd-journal08:53:031
317396399169,5cyclictest335557-21systemd-journal08:39:590
3173963991613,2cyclictest60350irq/132-enp0s29f1:rx-012:30:170
3173963991613,2cyclictest60350irq/132-enp0s29f1:rx-011:27:190
3173963991613,2cyclictest60350irq/132-enp0s29f1:rx-009:43:370
3173963991613,2cyclictest60350irq/132-enp0s29f1:rx-008:32:580
3173963991613,2cyclictest3382787-21kworker/u8:2+flush-259:010:30:250
3173963991610,4cyclictest509-21rs:main0
317397699151,4cyclictest3359596-21tr10:05:183
317397699151,3cyclictest513-21gdbus10:35:003
317397699151,3cyclictest513-21gdbus08:00:013
317397699151,3cyclictest3403963-21cpuspeed_turbos10:50:153
317397699151,3cyclictest3294853-21irqcore09:05:173
317397699151,2cyclictest3471159-21munin-run11:54:593
317397699150,5cyclictest335480-21sshd09:15:033
317397699150,4cyclictest3206080-21sed07:40:173
3173971991513,1cyclictest0-21swapper/207:25:012
3173971991510,4cyclictest3382787-21kworker/u8:2+flush-259:010:51:042
3173966991513,1cyclictest0-21swapper/111:40:001
3173966991512,2cyclictest3257363-21kworker/u8:3+events_unbound09:05:241
3173966991511,3cyclictest3277858-21kworker/u8:0+events_unbound10:15:231
3173963991513,1cyclictest60350irq/132-enp0s29f1:rx-009:10:170
3173963991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:180
3173963991513,1cyclictest60350irq/132-enp0s29f1:rx-008:00:210
3173963991512,2cyclictest60350irq/132-enp0s29f1:rx-011:15:130
3173963991512,2cyclictest60350irq/132-enp0s29f1:rx-010:08:050
3173963991512,2cyclictest60350irq/132-enp0s29f1:rx-009:20:130
3173963991512,1cyclictest0-21swapper/012:20:000
3173976991410,2cyclictest0-21swapper/308:15:203
317397699140,4cyclictest3278335-21fschecks_time08:50:163
317397199149,4cyclictest3271727-21kworker/u8:2+flush-259:010:10:002
317397199147,5cyclictest3226407-21/usr/sbin/munin08:00:202
3173971991412,1cyclictest0-21swapper/211:15:012
3173971991411,2cyclictest3264882-21kthreadcore08:35:202
3173971991410,3cyclictest3357067-21kworker/u8:1+flush-259:010:20:172
3173966991411,2cyclictest3357067-21kworker/u8:1+flush-259:010:40:141
317396399149,4cyclictest3315097-21apt-get09:25:120
3173963991411,2cyclictest60350irq/132-enp0s29f1:rx-008:40:090
3173963991410,3cyclictest3445310-21kworker/u8:0+events_unbound12:05:180
3173963991410,3cyclictest3424224-21kworker/u8:2+events_unbound11:30:170
317397699132,2cyclictest3200459-21apt-get07:35:133
317397199137,4cyclictest3272643-21latency_hist08:45:012
3173971991310,2cyclictest3325695-21fschecks_time09:35:142
3173971991310,2cyclictest3288413-21apt-get09:00:132
3173971991310,2cyclictest3119400-21kworker/u8:1+flush-259:008:00:002
3173971991310,2cyclictest127681-21kworker/u8:0+flush-259:007:10:252
3173971991310,1cyclictest0-21swapper/209:30:002
317397199130,9cyclictest3184281-21systemd-run07:20:002
317396699139,3cyclictest3429424-21kworker/u8:4+flush-259:011:15:231
317396699139,3cyclictest3319999-21kworker/u8:3+flush-259:009:40:201
317396699138,3cyclictest3272637-21awk08:44:591
3173966991310,2cyclictest3403106-21unixbench_multi10:45:251
3173966991310,2cyclictest3257363-21kworker/u8:3+flush-259:008:35:161
317397699121,4cyclictest3459843-21ntpq11:40:213
3173976991210,1cyclictest0-21swapper/309:50:003
3173971991210,1cyclictest3242344-21sed08:15:152
317396699129,2cyclictest3424529-21cpuspeed_turbos11:10:141
317397699115,4cyclictest3273463-21sed08:45:163
317397199119,1cyclictest0-21swapper/209:15:012
317397199119,1cyclictest0-21swapper/207:35:172
317397199116,4cyclictest3351444-21apt-get10:00:012
317397199116,3cyclictest3382787-21kworker/u8:2+flush-259:010:45:212
317396699118,3cyclictest3210796-21kworker/u8:2+flush-259:008:00:161
317396699118,2cyclictest3119400-21kworker/u8:1+flush-259:007:45:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional