You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 10:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue May 19, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3517405994031,6cyclictest335557-21systemd-journal21:35:002
3517398994035,3cyclictest3678378-21kworker/u8:0+flush-259:000:25:000
3517405993936,2cyclictest3682965-21fwupd21:45:572
3517405993833,4cyclictest3522488-21latency_hist19:15:002
3517405993630,4cyclictest3538049-21latency_hist19:30:002
3517403993633,2cyclictest3522721-21kworker/u8:3+flush-259:019:40:241
3517398993631,3cyclictest3699955-21kworker/u8:3+flush-259:022:30:000
3517408993531,3cyclictest3678378-21kworker/u8:0+flush-259:000:30:203
3517398993529,4cyclictest3610170-21ntpq20:35:230
3517408993330,2cyclictest3798369-21kworker/u8:3+events_unbound00:15:223
3517408993330,2cyclictest3782836-21kworker/u8:4+events_unbound23:40:223
3517408993327,4cyclictest3850303-21latency_hist00:30:003
3517405993326,5cyclictest3580057-21latency_hist20:10:002
3517398993327,4cyclictest3736052-21latency_hist22:40:010
3517408993229,2cyclictest3458736-21kworker/u8:2+events_unbound19:10:173
3517405993226,3cyclictest3678378-21kworker/u8:0+flush-259:000:10:172
3517403993229,2cyclictest3678378-21kworker/u8:0+events_unbound00:30:141
3517403993227,3cyclictest3559707-21kworker/u8:4+events_unbound19:55:251
3517403993225,5cyclictest3844323-21ntpq00:20:221
3517403993128,2cyclictest896866-21kworker/u8:5+events_unbound19:15:201
3517403993128,2cyclictest3678378-21kworker/u8:0+events_unbound23:00:011
3517408993027,2cyclictest3621292-21kworker/u8:0+events_unbound20:50:163
3517405993026,3cyclictest3678378-21kworker/u8:0+flush-259:000:30:162
3517403993028,1cyclictest3762170-21kworker/u8:2+events_unbound23:05:181
3517408992926,2cyclictest3688951-21kworker/u8:1+flush-259:022:15:243
3517408992926,2cyclictest3580284-21kworker/u8:3+events_unbound20:40:223
3517405992922,5cyclictest3715268-21latency_hist22:20:012
3517403992926,2cyclictest3782836-21kworker/u8:4+events_unbound23:40:201
3517408992825,2cyclictest3850329-21kworker/u8:2+events_unbound00:35:193
3517405992822,4cyclictest3814549-21diskstats23:55:102
3517403992825,2cyclictest3720725-21kworker/u8:2+flush-259:022:40:211
3517403992825,2cyclictest3720725-21kworker/u8:2+flush-259:022:35:211
3517403992825,2cyclictest3590423-21kworker/u8:1+events_unbound20:35:161
3517408992724,2cyclictest3512454-21kworker/u8:0+events_unbound20:10:213
3517405992722,3cyclictest3699955-21kworker/u8:3+flush-259:022:50:152
3517405992721,4cyclictest3839975-21latency_hist00:20:002
3517403992724,2cyclictest3678378-21kworker/u8:0+flush-259:000:10:251
3517403992724,2cyclictest3631628-21kworker/u8:3+flush-259:021:45:561
3517403992724,2cyclictest3590423-21kworker/u8:1+events_unbound20:25:131
3517408992624,1cyclictest3652475-21kworker/u8:4+flush-259:021:20:193
3517408992623,2cyclictest3736285-21kworker/u8:1+flush-259:022:55:263
3517408992623,2cyclictest3590423-21kworker/u8:1+events_unbound20:30:243
3517408992621,4cyclictest335557-21systemd-journal19:29:593
3517405992621,3cyclictest3652475-21kworker/u8:4+flush-259:021:25:152
3517403992623,2cyclictest3688951-21kworker/u8:1+events_unbound22:10:211
3517403992623,2cyclictest3678378-21kworker/u8:0+flush-259:023:10:251
3517403992622,3cyclictest3626715-21apt-get20:55:111
3517408992523,1cyclictest3590423-21kworker/u8:1+flush-259:021:10:243
3517408992522,2cyclictest3798369-21kworker/u8:3+events_unbound00:20:183
3517405992521,3cyclictest3855770-21apt-get00:35:122
3517405992521,3cyclictest3678378-21kworker/u8:0+flush-259:023:50:182
3517403992522,2cyclictest3798369-21kworker/u8:3+flush-259:000:00:151
3517403992522,2cyclictest3533117-21kworker/u8:2+flush-259:019:35:001
3517403992522,2cyclictest3512454-21kworker/u8:0+flush-259:019:45:161
3517403992521,3cyclictest3667776-21kworker/u8:5+events_unbound21:50:121
3517408992421,2cyclictest3720725-21kworker/u8:2+events_unbound22:35:233
3517408992421,2cyclictest3678378-21kworker/u8:0+flush-259:000:10:243
3517408992421,2cyclictest3678378-21kworker/u8:0+events_unbound00:07:383
3517405992421,2cyclictest3720725-21kworker/u8:2+events_unbound22:25:182
3517403992421,2cyclictest3590423-21kworker/u8:1+events_unbound21:40:171
3517403992420,3cyclictest3699955-21kworker/u8:3+events_unbound22:51:571
3517403992420,3cyclictest3605872-21kworker/u8:2+events_unbound21:00:191
3517403992420,3cyclictest3512454-21kworker/u8:0+events_unbound19:22:571
3517398992420,3cyclictest3673202-21apt-get21:40:090
3517398992418,4cyclictest3689588-21munin-node21:55:110
3517408992318,4cyclictest335557-21systemd-journal21:09:593
3517408992318,3cyclictest3756980-21/usr/sbin/munin23:00:153
3517405992319,3cyclictest3782836-21kworker/u8:4+events_unbound23:45:002
3517403992320,2cyclictest3736285-21kworker/u8:1+events_unbound22:45:221
3517403992320,2cyclictest3678378-21kworker/u8:0+events_unbound22:31:471
3517403992320,2cyclictest3678378-21kworker/u8:0+events_unbound21:55:181
3517398992320,2cyclictest3631628-21kworker/u8:3+flush-259:021:40:000
3517408992220,1cyclictest3772247-21idleruntime-cro23:15:013
3517408992219,2cyclictest3678378-21kworker/u8:0+events_unbound22:05:193
3517408992219,2cyclictest3590423-21kworker/u8:1+flush-259:021:35:203
3517408992219,2cyclictest3512454-21kworker/u8:0+events_unbound20:27:003
3517408992217,3cyclictest3673176-21/usr/sbin/munin21:40:213
3517405992216,4cyclictest3772256-21latency_hist23:15:012
3517403992219,2cyclictest3621292-21kworker/u8:0+flush-259:021:15:251
3517403992219,2cyclictest3580284-21kworker/u8:3+events_unbound20:20:011
3517403992219,2cyclictest3512454-21kworker/u8:0+events_unbound20:10:141
3517403992218,3cyclictest3667776-21kworker/u8:5+flush-259:022:00:151
3517403992217,3cyclictest3548325-21apt-get19:39:591
3517398992215,5cyclictest3787791-21latency_hist23:30:000
3517398992215,5cyclictest3682434-21ntpq21:45:240
3517408992118,2cyclictest3580284-21kworker/u8:3+events_unbound20:45:153
3517408992118,2cyclictest3559707-21kworker/u8:4+flush-259:019:55:203
3517408992116,3cyclictest3527664-21cron19:20:003
3517405992115,4cyclictest3704902-21latency_hist22:10:012
3517405992115,4cyclictest3543183-21latency_hist19:35:012
3517403992118,3cyclictest3590423-21kworker/u8:1+events_unbound21:12:581
3517403992118,2cyclictest3829726-21kworker/u8:1+events_unbound00:25:151
3517403992118,2cyclictest3590423-21kworker/u8:1+flush-259:021:30:201
3517403992118,2cyclictest3512454-21kworker/u8:0+events_unbound19:13:561
3517403992117,3cyclictest3678378-21kworker/u8:0+flush-259:023:55:101
3517398992118,2cyclictest3605872-21kworker/u8:2+flush-259:021:00:010
3517398992115,4cyclictest335557-21systemd-journal21:22:560
3517408992018,2cyclictest3590423-21kworker/u8:1+events_unbound20:35:223
3517408992017,2cyclictest3736285-21kworker/u8:1+events_unbound22:45:243
3517408992017,2cyclictest3678378-21kworker/u8:0+events_unbound23:06:583
3517408992017,2cyclictest3652475-21kworker/u8:4+events_unbound21:25:223
3517408992017,2cyclictest3590423-21kworker/u8:1+flush-259:020:55:113
3517408992016,3cyclictest3720725-21kworker/u8:2+events_unbound22:25:123
3517405992016,3cyclictest3777670-21/usr/sbin/munin23:20:152
3517405992016,3cyclictest3554030-21gpgv19:45:002
3517405992015,4cyclictest3684009-21apt-get21:50:102
3517405992015,4cyclictest3590423-21kworker/u8:1+events_unbound21:05:222
3517403992017,2cyclictest3798369-21kworker/u8:3+events_unbound23:45:181
3517403992017,2cyclictest3678378-21kworker/u8:0+events_unbound00:05:241
3517403992017,2cyclictest3580284-21kworker/u8:3+events_unbound20:40:201
3517403992017,2cyclictest3559707-21kworker/u8:4+flush-259:020:05:181
3517398992016,3cyclictest3699955-21kworker/u8:3+flush-259:022:45:170
3517398992016,3cyclictest3652475-21kworker/u8:4+flush-259:021:25:260
3517408991917,2cyclictest3543415-21kworker/u8:1+events_unbound20:00:243
3517408991916,2cyclictest3688951-21kworker/u8:1+events_unbound22:10:153
3517408991916,2cyclictest3678378-21kworker/u8:0+events_unbound22:20:543
3517408991916,2cyclictest3512454-21kworker/u8:0+flush-259:019:45:213
3517405991915,3cyclictest3580284-21kworker/u8:3+flush-259:020:45:012
3517405991914,3cyclictest335557-21systemd-journal19:46:342
3517403991915,3cyclictest3678378-21kworker/u8:0+flush-259:023:21:261
3517398991915,2cyclictest0-21swapper/023:39:590
3517398991914,4cyclictest3678378-21kworker/u8:0+flush-259:000:05:170
3517408991815,2cyclictest3798369-21kworker/u8:3+events_unbound00:00:253
3517408991815,2cyclictest3782836-21kworker/u8:4+flush-259:023:35:473
3517408991815,2cyclictest3782836-21kworker/u8:4+events_unbound23:30:113
3517408991815,2cyclictest3678378-21kworker/u8:0+events_unbound23:20:223
3517408991815,2cyclictest3667776-21kworker/u8:5+events_unbound22:01:453
3517408991815,2cyclictest3590423-21kworker/u8:1+events_unbound21:30:183
3517408991812,4cyclictest3736291-21/usr/sbin/munin22:40:183
3517405991815,2cyclictest3580284-21kworker/u8:3+flush-259:020:20:212
3517405991814,3cyclictest3580284-21kworker/u8:3+flush-259:020:15:242
3517405991812,4cyclictest335557-21systemd-journal19:51:352
3517403991815,2cyclictest3782836-21kworker/u8:4+flush-259:023:25:201
3517403991815,2cyclictest3678378-21kworker/u8:0+flush-259:023:50:241
3517403991815,2cyclictest3543415-21kworker/u8:1+events_unbound20:02:571
3517403991815,2cyclictest3533117-21kworker/u8:2+events_unbound19:25:171
3517403991814,3cyclictest3652475-21kworker/u8:4+events_unbound21:29:201
3517398991815,2cyclictest3741256-21systemd-run22:45:000
3517398991815,2cyclictest3621292-21kworker/u8:0+flush-259:020:50:160
3517398991814,3cyclictest3699955-21kworker/u8:3+flush-259:022:20:150
3517408991715,2cyclictest3678378-21kworker/u8:0+events_unbound23:55:033
3517408991715,2cyclictest3559707-21kworker/u8:4+events_unbound20:05:143
3517408991714,2cyclictest3605872-21kworker/u8:2+flush-259:021:00:263
3517408991714,2cyclictest3543415-21kworker/u8:1+flush-259:019:35:213
3517408991714,2cyclictest3512454-21kworker/u8:0+events_unbound19:50:133
3517405991714,2cyclictest3782836-21kworker/u8:4+flush-259:023:30:242
3517405991713,3cyclictest896866-21kworker/u8:5+events_unbound19:15:242
3517405991713,3cyclictest3762170-21kworker/u8:2+events_unbound23:19:562
3517405991713,3cyclictest3678378-21kworker/u8:0+events_unbound23:35:142
3517405991713,3cyclictest3512454-21kworker/u8:0+flush-259:019:20:162
3517403991714,2cyclictest3621292-21kworker/u8:0+events_unbound21:06:571
3517403991714,2cyclictest3560757-21kthreadcore19:50:161
3517403991713,3cyclictest3590423-21kworker/u8:1+flush-259:020:50:011
3517398991714,2cyclictest60350irq/132-enp0s29f1:rx-022:30:170
3517398991714,2cyclictest60350irq/132-enp0s29f1:rx-021:15:140
3517398991714,2cyclictest60350irq/132-enp0s29f1:rx-020:20:120
3517398991712,3cyclictest3522721-21kworker/u8:3+flush-259:019:30:260
3517398991711,4cyclictest509-21rs:main0
3517408991614,2cyclictest3522721-21kworker/u8:3+flush-259:019:40:203
3517408991614,1cyclictest3750284-21kthreadcore22:50:183
3517408991613,2cyclictest3782836-21kworker/u8:4+events_unbound23:25:213
3517408991613,2cyclictest3678378-21kworker/u8:0+events_unbound23:51:033
3517408991611,4cyclictest3527916-21/usr/sbin/munin19:20:143
3517405991613,2cyclictest3590423-21kworker/u8:1+flush-259:020:35:252
3517405991612,3cyclictest3688951-21kworker/u8:1+events_unbound22:13:572
3517405991612,3cyclictest3678378-21kworker/u8:0+flush-259:021:55:162
3517405991612,3cyclictest3621292-21kworker/u8:0+flush-259:020:50:242
3517405991612,3cyclictest3590423-21kworker/u8:1+flush-259:020:45:252
3517405991611,4cyclictest3736285-21kworker/u8:1+flush-259:022:56:012
3517405991610,4cyclictest3569772-21latency_hist20:00:012
351740599160,8cyclictest3574895-21munin-run20:05:002
3517403991613,2cyclictest3699955-21kworker/u8:3+flush-259:023:00:161
3517403991613,2cyclictest3678378-21kworker/u8:0+events_unbound23:35:251
3517403991613,2cyclictest3678378-21kworker/u8:0+events_unbound23:15:221
3517403991612,3cyclictest3699955-21kworker/u8:3+events_unbound22:08:381
3517403991612,3cyclictest3688951-21kworker/u8:1+events_unbound22:26:341
3517398991613,2cyclictest60350irq/132-enp0s29f1:rx-023:30:250
3517398991613,2cyclictest60350irq/132-enp0s29f1:rx-023:15:000
3517398991613,2cyclictest60350irq/132-enp0s29f1:rx-021:30:250
3517398991613,2cyclictest60350irq/132-enp0s29f1:rx-000:40:000
3517398991612,3cyclictest3819347-21gzip00:00:000
3517398991611,3cyclictest3813731-21gpgv23:55:000
351739899160,14cyclictest509-21rs:main0
3517408991514,1cyclictest3725903-21kworker/u8:4+events_unbound22:30:233
3517408991512,2cyclictest3798369-21kworker/u8:3+events_unbound23:48:583
3517408991512,2cyclictest3667776-21kworker/u8:5+events_unbound21:50:583
3517408991512,2cyclictest3631628-21kworker/u8:3+events_unbound21:45:583
3517408991512,2cyclictest3580284-21kworker/u8:3+events_unbound20:15:233
3517408991512,2cyclictest3533117-21kworker/u8:2+flush-259:019:30:263
3517405991513,1cyclictest0-21swapper/221:25:002
3517403991512,2cyclictest3699955-21kworker/u8:3+flush-259:022:20:161
3517403991512,2cyclictest3688951-21kworker/u8:1+events_unbound22:16:041
3517403991512,2cyclictest3652475-21kworker/u8:4+events_unbound21:35:251
3517403991512,2cyclictest3590423-21kworker/u8:1+events_unbound21:20:011
3517403991511,3cyclictest3512454-21kworker/u8:0+events_unbound20:24:551
3517403991510,4cyclictest335557-21systemd-journal00:18:571
3517398991513,2cyclictest60350irq/132-enp0s29f1:rx-023:43:470
3517398991513,2cyclictest60350irq/132-enp0s29f1:rx-020:28:510
3517398991513,1cyclictest60350irq/132-enp0s29f1:rx-023:45:290
3517398991513,1cyclictest60350irq/132-enp0s29f1:rx-023:20:270
3517398991513,1cyclictest60350irq/132-enp0s29f1:rx-022:11:040
3517398991513,1cyclictest60350irq/132-enp0s29f1:rx-020:30:240
3517398991513,1cyclictest60350irq/132-enp0s29f1:rx-019:40:160
3517398991513,1cyclictest60350irq/132-enp0s29f1:rx-000:00:250
3517398991512,2cyclictest60350irq/132-enp0s29f1:rx-023:19:120
3517398991512,2cyclictest60350irq/132-enp0s29f1:rx-021:10:570
3517398991512,2cyclictest60350irq/132-enp0s29f1:rx-019:53:400
3517398991512,2cyclictest60350irq/132-enp0s29f1:rx-019:45:140
3517398991512,2cyclictest60350irq/132-enp0s29f1:rx-019:15:200
3517398991511,2cyclictest0-21swapper/020:00:000
3517408991411,3cyclictest3762170-21kworker/u8:2+events_unbound23:19:263
351740599148,4cyclictest3647080-21latency_hist21:15:002
3517405991412,1cyclictest3717864-21kthreadcore22:20:172
3517405991411,2cyclictest3847714-21kthreadcore00:25:152
3517405991411,2cyclictest3798369-21kworker/u8:3+events_unbound00:10:012
3517405991411,2cyclictest0-21swapper/220:35:012
3517405991410,3cyclictest3720725-21kworker/u8:2+events_unbound22:39:572
3517405991410,3cyclictest3699955-21kworker/u8:3+flush-259:022:45:212
3517405991410,3cyclictest3590423-21kworker/u8:1+flush-259:021:17:022
3517403991411,2cyclictest3590423-21kworker/u8:1+events_unbound20:54:471
351739899149,4cyclictest3688951-21kworker/u8:1+flush-259:022:15:190
351739899149,4cyclictest3533117-21kworker/u8:2+flush-259:019:25:160
3517398991413,1cyclictest60350irq/132-enp0s29f1:rx-022:56:020
3517398991413,1cyclictest60350irq/132-enp0s29f1:rx-022:05:150
3517398991413,1cyclictest60350irq/132-enp0s29f1:rx-020:46:370
3517398991413,1cyclictest60350irq/132-enp0s29f1:rx-020:42:200
3517398991413,1cyclictest60350irq/132-enp0s29f1:rx-020:04:140
3517398991412,1cyclictest60350irq/132-enp0s29f1:rx-023:05:200
3517398991412,1cyclictest60350irq/132-enp0s29f1:rx-020:10:150
3517398991412,1cyclictest60350irq/132-enp0s29f1:rx-019:35:280
3517398991410,3cyclictest3798369-21kworker/u8:3+flush-259:000:30:010
3517398991410,2cyclictest0-21swapper/021:55:000
3517408991310,2cyclictest3512454-21kworker/u8:0+events_unbound20:21:323
351740599139,3cyclictest3605872-21kworker/u8:2+events_unbound21:00:262
351740599139,3cyclictest3590423-21kworker/u8:1+events_unbound20:25:152
351740599139,3cyclictest3559707-21kworker/u8:4+events_unbound20:14:562
3517405991310,2cyclictest3543679-21fschecks_time19:35:212
3517405991310,2cyclictest0-21swapper/200:00:192
3517403991310,2cyclictest3850329-21kworker/u8:2+events_unbound00:37:551
3517403991310,2cyclictest3782836-21kworker/u8:4+events_unbound23:30:371
3517403991310,2cyclictest3580284-21kworker/u8:3+flush-259:020:30:161
3517398991311,1cyclictest60350irq/132-enp0s29f1:rx-022:50:230
3517398991310,2cyclictest60350irq/132-enp0s29f1:rx-021:05:130
3517398991310,2cyclictest60350irq/132-enp0s29f1:rx-019:10:110
3517398991310,2cyclictest60350irq/132-enp0s29f1:rx-000:15:130
3517398991310,2cyclictest3830375-21irqcore00:10:170
351740899129,2cyclictest3678378-21kworker/u8:0+events_unbound21:56:063
351740899128,3cyclictest3621292-21kworker/u8:0+events_unbound21:19:113
351740599128,3cyclictest3667992-21/usr/sbin/munin21:35:212
351740599128,2cyclictest0-21swapper/223:10:002
351740599125,5cyclictest3630701-21ntpq20:55:212
351739899126,5cyclictest3698809-21ntpq22:00:210
3517398991211,1cyclictest60350irq/132-enp0s29f1:rx-020:05:130
351740599118,2cyclictest3757178-21fschecks_count23:00:152
351740599110,1cyclictest3730882-21awk22:35:002
351740599108,1cyclictest0-21swapper/223:30:002
351740599107,2cyclictest3803687-21cpuspeed_turbos23:45:162
351740599106,3cyclictest3736285-21kworker/u8:1+events_unbound22:44:592
351739899107,2cyclictest61150irq/133-enp0s29f1:tx-020:15:150
35174059997,1cyclictest0-21swapper/200:20:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional