You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 12:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu May 28, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3135741994440,3cyclictest3266082-21kworker/u8:4+flush-259:021:39:311
3135737994437,5cyclictest3322581-21latency_hist22:10:010
3135741994238,3cyclictest3369701-21apt-get22:55:121
3135741993936,2cyclictest3229639-21kworker/u8:3+events_unbound20:41:321
3135741993936,2cyclictest3193018-21kworker/u8:0+events_unbound20:20:181
3135741993935,3cyclictest3379785-21kworker/u8:1+events_unbound23:13:321
3135737993935,3cyclictest3442583-21apt-get00:05:120
3135743993832,4cyclictest3332908-21latency_hist22:20:012
3135741993835,2cyclictest3140910-21kworker/u8:4+events_unbound19:18:321
3135741993834,3cyclictest551483-21kworker/u8:1+events_unbound20:31:201
3135741993734,2cyclictest3281637-21kworker/u8:0+events_unbound21:45:231
3135741993733,3cyclictest3390135-21kworker/u8:0+events_unbound23:48:311
3135741993633,2cyclictest3379785-21kworker/u8:1+events_unbound23:19:321
3135741993633,2cyclictest3348425-21kworker/u8:1+events_unbound22:35:331
3135741993633,2cyclictest3219497-21kworker/u8:2+events_unbound20:37:321
3135741993633,2cyclictest3140910-21kworker/u8:4+events_unbound19:30:241
3135741993632,3cyclictest3364460-21kworker/u8:4+events_unbound23:00:331
3135741993632,3cyclictest3348425-21kworker/u8:1+events_unbound22:31:321
3135737993629,5cyclictest3379759-21latency_hist23:05:010
3135743993528,4cyclictest3281410-21latency_hist21:30:002
3135741993532,2cyclictest3281637-21kworker/u8:0+events_unbound21:50:121
3135741993532,2cyclictest3250528-21kworker/u8:2+events_unbound21:10:191
3135741993532,2cyclictest3186970-21kworker/u8:2+events_unbound20:00:141
3135741993532,2cyclictest3140910-21kworker/u8:4+events_unbound19:49:311
3135741993532,2cyclictest3097678-21kworker/u8:3+events_unbound19:14:331
3135741993531,3cyclictest3447480-21kworker/u8:2+events_unbound00:18:321
3135741993531,3cyclictest3379992-21kworker/u8:2+events_unbound23:23:321
3135741993531,3cyclictest3312298-21kworker/u8:0+events_unbound22:26:311
3135741993431,2cyclictest551483-21kworker/u8:1+events_unbound20:45:131
3135741993431,2cyclictest3338108-21kworker/u8:3+events_unbound22:45:231
3135741993431,2cyclictest3306835-21kworker/u8:2+events_unbound22:06:261
3135747993328,3cyclictest3306835-21kworker/u8:2+flush-259:022:00:153
3135747993327,4cyclictest3473253-21latency_hist00:35:013
3135741993330,2cyclictest3312298-21kworker/u8:0+events_unbound22:02:311
3135741993330,2cyclictest3186970-21kworker/u8:2+events_unbound20:14:311
3135741993329,3cyclictest3447480-21kworker/u8:2+events_unbound00:13:311
3135741993329,3cyclictest3291915-21kworker/u8:1+events_unbound22:11:291
3135743993226,4cyclictest3462926-21latency_hist00:25:012
3135741993229,2cyclictest551483-21kworker/u8:1+events_unbound21:00:321
3135741993229,2cyclictest3291915-21kworker/u8:1+events_unbound22:15:171
3135741993229,2cyclictest3229639-21kworker/u8:3+events_unbound21:26:121
3135737993227,3cyclictest3291947-21apt-get21:40:110
3135747993127,3cyclictest551483-21kworker/u8:1+flush-259:020:59:593
3135747993127,3cyclictest3343733-21gpgv22:30:013
3135747993127,3cyclictest3146308-21/usr/sbin/munin19:20:193
3135743993126,4cyclictest3213885-21gpgv20:25:012
3135741993128,2cyclictest3291915-21kworker/u8:1+events_unbound22:20:241
3135741993128,2cyclictest3140910-21kworker/u8:4+events_unbound19:40:191
3135741993127,3cyclictest3266082-21kworker/u8:4+events_unbound21:40:251
3135737993126,3cyclictest3291915-21kworker/u8:1+flush-259:022:15:010
3135737993125,4cyclictest3364233-21latency_hist22:50:010
3135737993124,5cyclictest3187817-21latency_hist20:00:010
3135747993023,5cyclictest3186905-21ntpq19:55:203
3135741993027,2cyclictest551483-21kworker/u8:1+events_unbound21:20:201
3135741993027,2cyclictest3447480-21kworker/u8:2+events_unbound00:30:151
3135741993027,2cyclictest3447480-21kworker/u8:2+events_unbound00:25:151
3135737993024,4cyclictest3146301-21kworker/u8:0+flush-259:019:20:160
3135747992925,3cyclictest3390135-21kworker/u8:0+flush-259:000:02:243
3135741992926,2cyclictest3266082-21kworker/u8:4+events_unbound21:16:231
3135741992926,2cyclictest3140910-21kworker/u8:4+events_unbound19:50:251
3135741992925,3cyclictest551483-21kworker/u8:1+events_unbound19:23:341
3135741992923,4cyclictest3286576-21latency_hist21:35:011
3135743992822,4cyclictest335557-21systemd-journal21:46:142
3135741992825,2cyclictest3338108-21kworker/u8:3+events_unbound23:25:171
3135741992825,2cyclictest3208675-21kworker/u8:3+events_unbound20:25:241
3135747992722,4cyclictest3266082-21kworker/u8:4+flush-259:021:45:003
3135743992723,3cyclictest3473252-21apt-get00:35:012
3135741992724,2cyclictest3390135-21kworker/u8:0+events_unbound00:08:301
3135741992724,2cyclictest3291915-21kworker/u8:1+events_unbound21:56:141
3135743992623,2cyclictest3260260-21kworker/u8:0+flush-259:021:10:012
3135743992622,3cyclictest3213669-21apt-get20:25:012
3135743992621,3cyclictest509-21rs:main2
3135741992623,2cyclictest3395313-21kworker/u8:4+events_unbound23:35:271
3135741992623,2cyclictest3390135-21kworker/u8:0+events_unbound00:03:331
3135741992623,2cyclictest3146301-21kworker/u8:0+events_unbound19:36:141
3135741992623,2cyclictest3140910-21kworker/u8:4+events_unbound19:26:221
3135737992621,4cyclictest335557-21systemd-journal20:05:010
3135737992620,4cyclictest3214352-21apt-get20:25:090
3135747992522,2cyclictest551483-21kworker/u8:1+flush-259:021:00:163
3135747992520,4cyclictest3337167-21ntpq22:20:193
3135743992520,3cyclictest335557-21systemd-journal21:16:312
3135741992522,2cyclictest3473073-21kworker/u8:3+events_unbound00:38:311
3135741992522,2cyclictest3229851-21kworker/u8:4+events_unbound20:51:311
3135741992521,3cyclictest3245405-21apt-get20:55:101
3135737992520,3cyclictest3255759-21apt-get21:05:100
3135747992422,2cyclictest3353927-21kworker/u8:0+flush-259:022:50:003
3135747992417,5cyclictest3219270-21latency_hist20:30:003
3135743992420,3cyclictest3306835-21kworker/u8:2+flush-259:022:10:202
3135741992421,2cyclictest3379785-21kworker/u8:1+events_unbound23:06:341
3135743992320,2cyclictest3395313-21kworker/u8:4+flush-259:023:44:592
3135741992320,2cyclictest3260657-21sh21:09:591
3135737992320,2cyclictest3140910-21kworker/u8:4+flush-259:020:10:000
3135737992317,4cyclictest335557-21systemd-journal19:45:000
3135737992316,5cyclictest3405164-21ntpq23:25:190
3135747992216,4cyclictest3380000-21/usr/sbin/munin23:05:133
3135743992219,2cyclictest3338108-21kworker/u8:3+events_unbound23:30:002
3135743992217,3cyclictest3307407-21apt-get21:55:112
3135741992219,2cyclictest3353927-21kworker/u8:0+events_unbound22:40:171
3135741992218,3cyclictest3390135-21kworker/u8:0+flush-259:023:55:001
3135737992218,3cyclictest3266082-21kworker/u8:4+flush-259:021:35:160
3135737992217,4cyclictest3343247-21apt-get22:30:010
3135747992117,3cyclictest3390135-21kworker/u8:0+flush-259:000:00:003
3135743992118,2cyclictest3198382-21/usr/sbin/munin20:10:142
3135743992115,4cyclictest3166744-21apt-get19:40:022
3135741992118,2cyclictest3338108-21kworker/u8:3+events_unbound23:30:191
3135741992118,2cyclictest3186970-21kworker/u8:2+events_unbound20:19:221
3135737992118,2cyclictest3140910-21kworker/u8:4+flush-259:019:15:510
3135737992115,4cyclictest3431974-21latency_hist23:55:000
3135737992115,4cyclictest3343247-21apt-get22:30:000
3135747992017,2cyclictest3281637-21kworker/u8:0+events_unbound21:45:213
3135747992017,2cyclictest3250528-21kworker/u8:2+flush-259:021:15:003
3135743992018,1cyclictest3156100-21fwupd19:26:212
3135743992016,3cyclictest551483-21kworker/u8:1+flush-259:021:20:202
3135743992016,3cyclictest3395840-21gpgv23:20:012
3135743992016,3cyclictest335557-21systemd-journal22:45:002
3135743992016,3cyclictest3349078-21apt-get22:35:102
3135741992017,3cyclictest551483-21kworker/u8:1+events_unbound20:07:111
3135741992017,2cyclictest3457479-21kworker/u8:3+events_unbound00:23:351
3135741992017,2cyclictest3379992-21kworker/u8:2+events_unbound23:56:331
3135737992018,1cyclictest3092472-21kworker/0:0+pm19:26:210
3135737992016,3cyclictest3271294-21apt-get21:20:100
3135747991913,4cyclictest335557-21systemd-journal20:44:313
3135747991913,4cyclictest3307152-21latency_hist21:55:013
3135743991915,3cyclictest507-21in:imuxsock22:30:002
3135741991915,3cyclictest3140910-21kworker/u8:4+events_unbound19:56:081
3135737991915,3cyclictest3353927-21kworker/u8:0+flush-259:022:51:020
3135747991814,2cyclictest0-21swapper/323:40:003
3135743991815,2cyclictest3140910-21kworker/u8:4+flush-259:020:10:022
3135743991812,4cyclictest3452575-21latency_hist00:15:012
3135741991815,2cyclictest3353927-21kworker/u8:0+events_unbound22:51:491
3135737991815,2cyclictest3437748-21kworker/u8:1+flush-259:000:20:010
3135737991814,3cyclictest3406354-21apt-get23:30:110
3135737991814,2cyclictest60350irq/132-enp0s29f1:rx-023:55:130
3135737991812,5cyclictest335557-21systemd-journal22:25:010
3135737991812,4cyclictest3478850-21latency_hist00:40:010
3135747991713,3cyclictest3390135-21kworker/u8:0+flush-259:023:45:013
3135747991713,3cyclictest3208709-21apt-get20:20:123
3135743991714,2cyclictest507-21in:imuxsock20:19:592
3135743991713,3cyclictest3219497-21kworker/u8:2+flush-259:020:30:162
3135737991713,3cyclictest3229639-21kworker/u8:3+flush-259:020:43:030
3135737991712,4cyclictest3229851-21kworker/u8:4+flush-259:020:55:250
3135737991711,4cyclictest3400865-21latency_hist23:25:010
3135737991711,4cyclictest3165837-21ntpq19:35:210
3135747991614,1cyclictest3200702-21kthreadcore20:10:183
3135747991610,4cyclictest3276490-21/usr/sbin/munin21:25:173
3135743991614,1cyclictest0-21swapper/219:55:012
3135743991613,2cyclictest3281637-21kworker/u8:0+events_unbound21:40:202
3135743991613,2cyclictest3140910-21kworker/u8:4+flush-259:019:20:002
3135743991610,5cyclictest3395276-21apt-get23:20:002
3135737991614,1cyclictest60350irq/132-enp0s29f1:rx-021:55:210
3135737991613,2cyclictest60350irq/132-enp0s29f1:rx-021:14:310
3135737991613,2cyclictest60350irq/132-enp0s29f1:rx-000:31:240
3135737991613,2cyclictest60350irq/132-enp0s29f1:rx-000:10:190
3135747991512,2cyclictest3460312-21kthreadcore00:20:173
3135747991512,2cyclictest3437748-21kworker/u8:1+flush-259:000:15:163
3135747991512,2cyclictest3266525-21irqcore21:15:173
3135747991512,2cyclictest3195542-21kthreadcore20:05:173
3135743991513,1cyclictest3281637-21kworker/u8:0+events_unbound21:30:142
3135743991513,1cyclictest0-21swapper/222:35:002
3135743991512,2cyclictest3437748-21kworker/u8:1+events_unbound00:35:212
3135743991512,2cyclictest3379785-21kworker/u8:1+events_unbound23:10:172
3135743991512,2cyclictest3266082-21kworker/u8:4+events_unbound21:35:232
3135743991511,2cyclictest551483-21kworker/u8:1+flush-259:021:00:262
313573799158,5cyclictest335557-21systemd-journal21:35:000
3135737991513,2cyclictest60350irq/132-enp0s29f1:rx-021:48:190
3135737991513,1cyclictest60350irq/132-enp0s29f1:rx-023:45:240
3135737991513,1cyclictest60350irq/132-enp0s29f1:rx-022:00:230
3135737991513,1cyclictest60350irq/132-enp0s29f1:rx-021:25:180
3135737991513,1cyclictest60350irq/132-enp0s29f1:rx-020:15:230
3135737991513,1cyclictest60350irq/132-enp0s29f1:rx-000:25:170
313574799148,3cyclictest335557-21systemd-journal00:30:003
3135747991413,1cyclictest4950ktimers/320:00:233
3135747991412,1cyclictest3390114-21sh23:15:003
3135747991412,1cyclictest0-21swapper/323:40:183
3135747991411,2cyclictest0-21swapper/320:55:003
3135747991411,1cyclictest1-21systemd21:30:323
3135747991411,1cyclictest0-21swapper/319:40:003
3135747991410,3cyclictest3140910-21kworker/u8:4+flush-259:019:40:173
313574399149,3cyclictest3312721-21cut22:00:132
313574399148,4cyclictest335557-21systemd-journal23:06:262
3135743991412,1cyclictest0-21swapper/219:45:152
3135743991411,2cyclictest551483-21kworker/u8:1+flush-259:019:55:212
3135743991410,3cyclictest3140910-21kworker/u8:4+events_unbound19:30:142
3135737991413,1cyclictest60350irq/132-enp0s29f1:rx-023:09:330
3135737991412,1cyclictest60350irq/132-enp0s29f1:rx-023:40:240
3135737991412,1cyclictest60350irq/132-enp0s29f1:rx-021:00:150
3135737991412,1cyclictest60350irq/132-enp0s29f1:rx-020:53:320
3135737991412,1cyclictest60350irq/132-enp0s29f1:rx-020:35:510
3135737991411,2cyclictest60350irq/132-enp0s29f1:rx-023:35:240
3135737991411,2cyclictest60350irq/132-enp0s29f1:rx-021:16:560
3135737991411,2cyclictest60350irq/132-enp0s29f1:rx-020:21:330
3135737991411,2cyclictest0-21swapper/019:15:000
3135737991410,3cyclictest3447480-21kworker/u8:2+flush-259:000:20:160
313574799139,3cyclictest3306835-21kworker/u8:2+events_unbound22:15:003
313574799139,3cyclictest3271552-21fschecks_time21:20:143
3135747991310,2cyclictest3320006-21kthreadcore22:05:183
3135747991310,2cyclictest0-21swapper/323:19:593
313574399139,1cyclictest0-21swapper/220:55:242
3135743991311,1cyclictest0-21swapper/220:45:122
3135743991310,2cyclictest3410300-21ntp_kernel_err23:30:202
3135743991310,2cyclictest3333365-21fschecks_count22:20:132
3135743991310,2cyclictest3317950-21fschecks_time22:05:142
3135743991310,2cyclictest3146592-21fschecks_time19:20:132
313573799137,4cyclictest335557-21systemd-journal22:59:590
3135737991312,1cyclictest60350irq/132-enp0s29f1:rx-021:52:080
3135737991311,2cyclictest60350irq/132-enp0s29f1:rx-022:16:010
3135737991311,1cyclictest60350irq/132-enp0s29f1:rx-022:40:270
3135737991311,1cyclictest60350irq/132-enp0s29f1:rx-020:30:190
3135737991311,1cyclictest60350irq/132-enp0s29f1:rx-019:30:160
3135737991310,2cyclictest60350irq/132-enp0s29f1:rx-023:14:330
3135737991310,2cyclictest60350irq/132-enp0s29f1:rx-022:35:140
3135737991310,2cyclictest60350irq/132-enp0s29f1:rx-020:10:120
3135737991310,2cyclictest60350irq/132-enp0s29f1:rx-000:00:270
313574799129,2cyclictest3427409-21irqcore23:50:153
313574799129,2cyclictest3312270-21idleruntime-cro22:00:003
313574799129,2cyclictest0-21swapper/322:30:003
313574399129,2cyclictest3379992-21kworker/u8:2+events_unbound23:55:142
313574399129,2cyclictest3168446-21kthreadcore19:40:162
313574399128,2cyclictest3261327-21irqcore21:10:162
313574399126,4cyclictest3442305-21cron00:05:002
313574399121,9cyclictest0-21swapper/220:55:002
313573799129,2cyclictest60350irq/132-enp0s29f1:rx-023:15:220
313573799126,4cyclictest3181752-21ntpq19:50:190
3135737991210,1cyclictest60350irq/132-enp0s29f1:rx-019:49:070
313574799119,1cyclictest3203991-21irqcore20:15:163
313574799119,1cyclictest0-21swapper/323:00:003
313574799119,1cyclictest0-21swapper/320:45:123
313574799117,3cyclictest3291915-21kworker/u8:1+flush-259:022:15:063
313574799116,3cyclictest3447152-21sshd00:06:313
313574399119,1cyclictest0-21swapper/223:50:242
313574399118,2cyclictest551483-21kworker/u8:1+flush-259:020:00:162
313574399118,2cyclictest3353927-21kworker/u8:0+flush-259:022:55:132
313574399118,1cyclictest0-21swapper/223:45:252
313574399117,2cyclictest3137733-21kthreadcore19:10:182
313574399117,2cyclictest0-21swapper/223:35:252
313573799118,2cyclictest60350irq/132-enp0s29f1:rx-020:45:230
313574799108,1cyclictest0-21swapper/323:00:183
313574799107,2cyclictest3224451-21idleruntime-cro20:34:593
313574799107,2cyclictest3140901-21systemd-run19:15:013
313574399104,4cyclictest490-21dbus-daemon00:30:012
313574199102,3cyclictest32-21ksoftirqd/119:10:001
31357479994,4cyclictest3155501-21seq19:25:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional