You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 16:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Aug 27, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3702781995146,4cyclictest3754927-21gpgv08:00:013
3702781994845,2cyclictest3692115-21kworker/u8:2+flush-259:008:00:243
3702772994642,3cyclictest3895184-21kworker/u8:1+flush-259:010:30:320
3702772994641,3cyclictest3977913-21kworker/u8:0+flush-259:011:55:260
3702781994441,2cyclictest3874307-21kworker/u8:4+events_unbound10:05:253
3702781994340,2cyclictest3999059-21apt-get11:55:013
3702772994238,3cyclictest3686308-21kworker/u8:0+flush-259:007:25:240
3702781994138,2cyclictest3728987-21kworker/u8:3+events_unbound08:15:233
3702778994034,4cyclictest3827553-21latency_hist09:10:012
3702781993937,1cyclictest3910718-21kworker/u8:2+events_unbound11:30:233
3702781993936,2cyclictest3977913-21kworker/u8:0+flush-259:011:40:233
3702772993936,2cyclictest4004624-21kworker/u8:1+events_unbound12:15:010
3702781993835,2cyclictest3692115-21kworker/u8:2+flush-259:008:55:153
3702778993835,2cyclictest3895184-21kworker/u8:1+events_unbound10:30:162
3702781993733,3cyclictest3926869-21apt-get10:45:133
3702778993734,2cyclictest3791373-21kworker/u8:1+events_unbound08:50:232
3702775993731,4cyclictest3994120-21apt-get11:50:111
3702772993729,6cyclictest3837906-21latency_hist09:20:010
3702781993633,2cyclictest3843077-21kworker/u8:3+flush-259:009:35:113
3702778993629,5cyclictest4014993-21latency_hist12:10:002
3702775993632,3cyclictest4040674-21apt-get12:33:081
3702775993632,2cyclictest4025582-21apt-get12:20:121
3702775993631,3cyclictest4041133-21apt-get12:35:091
3702772993630,4cyclictest3801978-21apt-get08:45:110
3702781993532,2cyclictest3931779-21kworker/u8:3+flush-259:011:35:163
3702778993532,2cyclictest3692115-21kworker/u8:2+events_unbound07:27:102
3702778993529,4cyclictest3999201-21cat11:55:002
3702781993432,1cyclictest3868491-21kworker/u8:3+events_unbound10:20:243
3702781993430,3cyclictest3791373-21kworker/u8:1+events_unbound09:25:123
3702781993330,2cyclictest3910718-21kworker/u8:2+flush-259:011:00:193
3702781993329,3cyclictest3692115-21kworker/u8:2+flush-259:007:40:143
3702778993331,1cyclictest4004624-21kworker/u8:1+events_unbound12:35:442
3702778993330,2cyclictest3858559-21kworker/u8:1+events_unbound09:40:132
3702778993330,2cyclictest3817232-21kworker/u8:0+events_unbound09:26:082
3702778993330,2cyclictest3692115-21kworker/u8:2+events_unbound08:37:092
3702778993327,4cyclictest3946433-21ntpq11:00:212
3702775993329,3cyclictest3744399-21kworker/u8:0+events_unbound08:25:241
3702772993329,3cyclictest4030732-21apt-get12:25:100
3702772993328,4cyclictest3754808-21latency_hist08:00:010
3702772993328,3cyclictest3910718-21kworker/u8:2+flush-259:011:00:000
3702772993328,3cyclictest3910718-21kworker/u8:2+events_unbound11:00:170
3702781993225,5cyclictest335557-21systemd-journal07:15:013
3702778993229,2cyclictest3977913-21kworker/u8:0+events_unbound12:15:092
3702775993226,4cyclictest3718886-21apt-get07:25:121
3702772993229,2cyclictest4035829-21kworker/u8:4+flush-259:012:35:130
3702772993228,3cyclictest3874307-21kworker/u8:4+flush-259:010:15:420
3702772993228,3cyclictest3692115-21kworker/u8:2+events_unbound07:35:160
3702778993129,2cyclictest3993876-21kworker/u8:2+events_unbound12:12:092
3702778993129,2cyclictest3977913-21kworker/u8:0+events_unbound11:44:102
3702778993128,2cyclictest3910718-21kworker/u8:2+events_unbound11:27:082
3702778993128,2cyclictest3910718-21kworker/u8:2+events_unbound10:55:252
3702778993128,2cyclictest3895184-21kworker/u8:1+events_unbound10:38:082
3702778993128,2cyclictest3692115-21kworker/u8:2+events_unbound08:08:092
3702781993027,2cyclictest3744399-21kworker/u8:0+flush-259:008:25:153
3702781993026,3cyclictest3692115-21kworker/u8:2+events_unbound08:40:193
3702778993028,2cyclictest3957864-21kworker/u8:1+events_unbound11:30:542
3702778993027,2cyclictest3905256-21kworker/u8:0+events_unbound10:49:102
3702778993027,2cyclictest3791373-21kworker/u8:1+events_unbound08:58:092
3702772993026,3cyclictest3931984-21kworker/u8:4+flush-259:011:05:240
3702781992926,2cyclictest3910718-21kworker/u8:2+flush-259:010:30:293
3702781992925,3cyclictest3817232-21kworker/u8:0+events_unbound09:05:223
3702778992927,2cyclictest3931779-21kworker/u8:3+events_unbound11:10:292
3702778992926,2cyclictest3977913-21kworker/u8:0+events_unbound11:55:272
3702775992923,4cyclictest3874073-21latency_hist09:55:011
3702772992925,3cyclictest3868491-21kworker/u8:3+flush-259:010:25:250
3702772992925,3cyclictest3692115-21kworker/u8:2+events_unbound07:15:180
3702772992923,4cyclictest335557-21systemd-journal07:20:030
3702781992825,2cyclictest3977913-21kworker/u8:0+flush-259:012:15:163
3702778992826,2cyclictest3702961-21kworker/u8:1+events_unbound07:44:582
3702778992824,3cyclictest3702961-21kworker/u8:1+events_unbound07:47:092
3702772992824,3cyclictest3957901-21apt-get11:15:110
3702772992824,3cyclictest3744399-21kworker/u8:0+events_unbound08:25:170
3702778992725,2cyclictest3728987-21kworker/u8:3+events_unbound07:51:092
3702778992724,2cyclictest3931779-21kworker/u8:3+events_unbound11:16:082
3702778992724,2cyclictest3868491-21kworker/u8:3+events_unbound10:11:082
3702778992724,2cyclictest3728987-21kworker/u8:3+events_unbound08:10:082
3702778992724,2cyclictest3692115-21kworker/u8:2+events_unbound09:10:272
3702778992723,3cyclictest3874306-21kworker/u8:2+flush-259:010:00:242
3702772992723,3cyclictest3931779-21kworker/u8:3+events_unbound11:20:170
3702772992723,3cyclictest3931779-21kworker/u8:3+events_unbound11:20:160
3702781992623,2cyclictest4035616-21kworker/u8:3+flush-259:012:33:103
3702781992623,2cyclictest3993876-21kworker/u8:2+events_unbound12:05:193
3702781992623,2cyclictest3931779-21kworker/u8:3+events_unbound11:25:213
3702781992623,2cyclictest3692115-21kworker/u8:2+flush-259:007:20:143
3702781992623,2cyclictest3692115-21kworker/u8:2+events_unbound09:04:103
3702778992623,2cyclictest3692115-21kworker/u8:2+events_unbound07:30:182
3702775992624,1cyclictest3843077-21kworker/u8:3+events_unbound09:35:011
3702772992622,3cyclictest3983742-21apt-get11:40:120
3702772992622,3cyclictest3977913-21kworker/u8:0+flush-259:012:20:000
3702772992622,3cyclictest3931779-21kworker/u8:3+events_unbound11:35:240
3702772992521,3cyclictest3692115-21kworker/u8:2+flush-259:007:40:130
3702772992520,3cyclictest3692115-21kworker/u8:2+events_unbound07:30:170
3702781992422,1cyclictest3692115-21kworker/u8:2+events_unbound08:45:213
3702781992418,3cyclictest3868491-21kworker/u8:3+events_unbound10:10:193
3702778992419,4cyclictest335557-21systemd-journal07:25:012
3702775992420,3cyclictest3910718-21kworker/u8:2+flush-259:011:05:171
3702775992420,3cyclictest3817232-21kworker/u8:0+flush-259:009:45:261
3702772992418,4cyclictest3978300-21latency_hist11:35:000
3702781992320,2cyclictest4004624-21kworker/u8:1+events_unbound12:37:093
3702781992318,4cyclictest3900345-21latency_hist10:20:013
3702781992317,2cyclictest3993876-21kworker/u8:2+events_unbound12:10:183
3702778992321,2cyclictest3931984-21kworker/u8:4+events_unbound11:06:082
3702778992320,2cyclictest3817232-21kworker/u8:0+events_unbound09:22:082
3702778992320,2cyclictest3817232-21kworker/u8:0+events_unbound09:15:272
3702775992319,3cyclictest3931779-21kworker/u8:3+flush-259:011:30:001
3702775992318,3cyclictest3749881-21/usr/sbin/munin07:55:141
3702775992317,3cyclictest335557-21systemd-journal09:01:081
3702772992319,3cyclictest3692115-21kworker/u8:2+events_unbound07:10:210
3702772992317,5cyclictest3858809-21apt-get09:40:120
3702781992220,2cyclictest3977913-21kworker/u8:0+events_unbound12:25:093
3702781992219,2cyclictest3977913-21kworker/u8:0+events_unbound11:45:143
3702781992219,2cyclictest3910718-21kworker/u8:2+events_unbound10:50:163
3702781992219,2cyclictest3910718-21kworker/u8:2+events_unbound10:35:213
3702781992219,2cyclictest3692115-21kworker/u8:2+events_unbound07:50:153
3702781992217,2cyclictest3858559-21kworker/u8:1+events_unbound09:50:153
3702778992219,2cyclictest3977913-21kworker/u8:0+events_unbound12:28:092
3702778992218,3cyclictest3692115-21kworker/u8:2+events_unbound07:35:082
3702778992217,4cyclictest3884414-21apt-get10:05:012
3702775992219,2cyclictest3905256-21kworker/u8:0+flush-259:010:55:001
3702775992218,3cyclictest3728987-21kworker/u8:3+flush-259:007:50:171
3702775992215,5cyclictest335557-21systemd-journal11:45:001
3702772992219,2cyclictest3728987-21kworker/u8:3+events_unbound08:35:200
3702781992118,2cyclictest3977913-21kworker/u8:0+flush-259:012:21:093
3702781992118,2cyclictest3744399-21kworker/u8:0+events_unbound08:20:273
3702781992118,2cyclictest3728987-21kworker/u8:3+flush-259:008:35:163
3702781992118,2cyclictest3692115-21kworker/u8:2+events_unbound09:13:103
3702781992117,3cyclictest3905256-21kworker/u8:0+events_unbound10:55:133
3702781992117,3cyclictest3702961-21kworker/u8:1+events_unbound07:15:243
3702781992115,4cyclictest335557-21systemd-journal08:50:143
3702778992119,2cyclictest3817232-21kworker/u8:0+events_unbound09:32:092
3702778992118,2cyclictest3744399-21kworker/u8:0+events_unbound08:32:092
3702778992117,3cyclictest3713215-21gpgv07:20:002
3702775992117,3cyclictest3895427-21apt-get10:15:111
3702775992115,4cyclictest3713011-21latency_hist07:20:001
3702772992117,3cyclictest3874306-21kworker/u8:2+events_unbound10:04:080
3702772992117,3cyclictest3817232-21kworker/u8:0+events_unbound09:20:200
3702772992117,3cyclictest3692115-21kworker/u8:2+flush-259:008:50:150
3702772992116,4cyclictest3692115-21kworker/u8:2+events_unbound08:00:160
3702772992114,5cyclictest335557-21systemd-journal09:55:000
3702781992017,2cyclictest3993876-21kworker/u8:2+events_unbound12:01:103
3702781992017,2cyclictest3868491-21kworker/u8:3+events_unbound09:55:143
3702781992017,2cyclictest3817232-21kworker/u8:0+flush-259:009:15:243
370277899207,8cyclictest41-21ksoftirqd/208:00:012
3702778992017,2cyclictest3843077-21kworker/u8:3+events_unbound09:38:102
3702778992017,2cyclictest3728987-21kworker/u8:3+events_unbound08:15:092
3702775992017,2cyclictest3692115-21kworker/u8:2+flush-259:007:20:241
3702775992017,2cyclictest3692115-21kworker/u8:2+events_unbound07:45:251
3702775992016,3cyclictest3982549-21ntp_kernel_err11:35:201
3702775992016,3cyclictest3858559-21kworker/u8:1+flush-259:009:40:241
3702772992016,2cyclictest3868491-21kworker/u8:3+flush-259:010:10:260
370277899195,3cyclictest41-21ksoftirqd/212:05:012
3702778991916,2cyclictest4004624-21kworker/u8:1+events_unbound12:20:272
3702778991916,2cyclictest3931779-21kworker/u8:3+events_unbound11:35:092
3702778991915,3cyclictest3905256-21kworker/u8:0+events_unbound10:50:062
3702778991915,3cyclictest3692115-21kworker/u8:2+events_unbound08:00:082
3702775991915,3cyclictest3931779-21kworker/u8:3+flush-259:011:50:011
3702775991915,3cyclictest3905760-21apt-get10:25:111
3702775991913,4cyclictest3812061-21latency_hist08:55:001
3702775991913,4cyclictest3738390-21ntpq07:40:191
3702772991916,2cyclictest3977913-21kworker/u8:0+events_unbound11:45:160
3702772991916,2cyclictest3692115-21kworker/u8:2+flush-259:008:05:240
3702781991815,2cyclictest3910718-21kworker/u8:2+events_unbound11:05:113
3702778991815,2cyclictest3692115-21kworker/u8:2+events_unbound08:43:082
3702778991815,2cyclictest3692115-21kworker/u8:2+events_unbound08:24:092
3702778991814,3cyclictest3692115-21kworker/u8:2+events_unbound09:03:012
3702775991814,3cyclictest3910718-21kworker/u8:2+flush-259:011:30:171
3702775991813,3cyclictest3868491-21kworker/u8:3+events_unbound10:10:171
3702775991812,4cyclictest3857635-21ntpq09:35:201
3702772991815,2cyclictest4004624-21kworker/u8:1+flush-259:012:20:250
3702772991815,2cyclictest3791373-21kworker/u8:1+flush-259:009:25:250
3702772991815,2cyclictest3744399-21kworker/u8:0+flush-259:008:20:200
3702772991813,4cyclictest4004624-21kworker/u8:1+events_unbound12:30:180
3702772991813,3cyclictest3692115-21kworker/u8:2+flush-259:008:10:220
3702772991812,4cyclictest3801712-21latency_hist08:45:000
3702781991714,2cyclictest3744399-21kworker/u8:0+events_unbound08:30:123
3702781991713,3cyclictest3874306-21kworker/u8:2+events_unbound10:00:193
3702781991712,2cyclictest3868491-21kworker/u8:3+events_unbound10:29:083
3702778991713,3cyclictest4004624-21kworker/u8:1+events_unbound12:33:162
3702778991713,3cyclictest3692115-21kworker/u8:2+events_unbound08:46:482
3702775991713,3cyclictest3910718-21kworker/u8:2+flush-259:010:45:011
3702775991713,2cyclictest3765810-21apt-get08:10:081
3702772991714,2cyclictest60350irq/132-enp0s29f1:rx-009:47:510
3702772991713,3cyclictest3993876-21kworker/u8:2+flush-259:012:00:160
3702772991713,3cyclictest3791373-21kworker/u8:1+events_unbound08:57:090
3702781991613,2cyclictest3858559-21kworker/u8:1+events_unbound09:40:193
3702781991613,2cyclictest3728987-21kworker/u8:3+events_unbound08:14:083
370277899163,2cyclictest0-21swapper/209:55:192
370277899162,4cyclictest490-21dbus-daemon08:29:592
3702778991613,2cyclictest3922121-21irqcore10:40:142
3702778991613,2cyclictest3868491-21kworker/u8:3+events_unbound10:23:152
3702778991612,3cyclictest3978322-21kworker/u8:4+events_unbound11:45:032
3702778991612,3cyclictest3868491-21kworker/u8:3+events_unbound10:18:042
3702778991610,4cyclictest3963059-21apt-get11:20:142
3702778991610,4cyclictest3963059-21apt-get11:20:132
3702775991614,1cyclictest3797250-21grep08:40:161
3702775991611,3cyclictest3692115-21kworker/u8:2+flush-259:007:30:161
3702772991614,1cyclictest3728987-21kworker/u8:3+events_unbound07:53:080
3702772991613,2cyclictest60350irq/132-enp0s29f1:rx-009:30:130
3702772991612,3cyclictest3977913-21kworker/u8:0+flush-259:012:05:150
3702772991612,3cyclictest3817232-21kworker/u8:0+flush-259:009:05:200
3702772991612,3cyclictest3692115-21kworker/u8:2+events_unbound08:30:180
3702781991512,2cyclictest3692115-21kworker/u8:2+events_unbound07:35:263
3702781991512,2cyclictest3692115-21kworker/u8:2+events_unbound07:33:083
370277899153,3cyclictest41-21ksoftirqd/207:10:212
3702778991512,2cyclictest3858559-21kworker/u8:1+events_unbound09:50:082
3702775991512,2cyclictest3960193-21kthreadcore11:15:181
3702775991512,2cyclictest3905499-21sh10:25:001
3702775991511,3cyclictest3889143-21ntp_offset10:05:231
3702772991513,1cyclictest60350irq/132-enp0s29f1:rx-011:50:140
3702772991513,1cyclictest60350irq/132-enp0s29f1:rx-010:51:080
3702772991513,1cyclictest60350irq/132-enp0s29f1:rx-010:35:230
3702772991512,2cyclictest60350irq/132-enp0s29f1:rx-011:11:420
3702772991512,2cyclictest60350irq/132-enp0s29f1:rx-010:40:130
3702772991512,2cyclictest60350irq/132-enp0s29f1:rx-010:22:320
3702772991512,2cyclictest507-21in:imuxsock09:40:000
3702772991511,3cyclictest3874307-21kworker/u8:4+flush-259:010:05:210
370278199148,4cyclictest3702697-21latency_hist07:10:003
3702781991411,2cyclictest3931779-21kworker/u8:3+events_unbound11:20:543
3702781991411,2cyclictest3931779-21kworker/u8:3+events_unbound11:20:533
3702781991411,2cyclictest3931779-21kworker/u8:3+events_unbound11:15:083
3702781991411,2cyclictest3686308-21kworker/u8:0+events_unbound07:25:053
3702781991410,3cyclictest3977913-21kworker/u8:0+flush-259:011:55:153
3702778991411,1cyclictest401ktimers/210:25:182
370277899140,4cyclictest41-21ksoftirqd/209:45:172
370277599149,3cyclictest3692115-21kworker/u8:2+flush-259:007:10:161
3702775991411,2cyclictest3963481-21sed11:20:191
3702775991411,2cyclictest3963481-21sed11:20:181
3702775991410,3cyclictest3977913-21kworker/u8:0+flush-259:011:55:201
3702775991410,3cyclictest3817232-21kworker/u8:0+flush-259:009:15:191
3702775991410,3cyclictest3692115-21kworker/u8:2+flush-259:008:30:191
3702775991410,2cyclictest0-21swapper/111:15:001
3702772991412,1cyclictest60350irq/132-enp0s29f1:rx-011:26:590
3702772991412,1cyclictest60350irq/132-enp0s29f1:rx-008:15:090
3702772991411,2cyclictest60350irq/132-enp0s29f1:rx-009:11:090
3702772991411,2cyclictest3905256-21kworker/u8:0+flush-259:010:50:000
3702772991411,2cyclictest3702961-21kworker/u8:1+flush-259:007:45:260
3702772991410,3cyclictest3874307-21kworker/u8:4+flush-259:009:55:180
370278199139,3cyclictest3910718-21kworker/u8:2+events_unbound11:10:553
370278199137,2cyclictest0-21swapper/307:45:163
3702781991312,1cyclictest3817232-21kworker/u8:0+flush-259:009:20:243
3702781991310,2cyclictest3905256-21kworker/u8:0+events_unbound10:41:163
3702781991310,2cyclictest3852980-21kworker/u8:2+events_unbound09:45:093
3702781991310,2cyclictest0-21swapper/309:35:003
370277599139,3cyclictest3910718-21kworker/u8:2+flush-259:010:35:161
370277599139,3cyclictest335557-21systemd-journal10:48:081
370277599137,4cyclictest335557-21systemd-journal10:35:001
370277599136,5cyclictest3781049-21latency_hist08:25:001
3702775991310,2cyclictest0-21swapper/110:00:161
370278199128,3cyclictest3728987-21kworker/u8:3+flush-259:008:05:063
370277599129,2cyclictest3847727-21unixbench_multi09:25:251
370277599129,2cyclictest3729619-21irqcore07:35:161
370277599128,3cyclictest3879260-21cron10:00:001
370277599128,3cyclictest3728987-21kworker/u8:3+flush-259:008:15:251
370277599128,3cyclictest335557-21systemd-journal12:19:561
370277599128,2cyclictest3817232-21kworker/u8:0+flush-259:009:20:131
370277599128,2cyclictest0-21swapper/108:45:221
370277599127,3cyclictest4020171-21latency_hist12:15:011
3702775991210,1cyclictest311ktimers/112:08:321
370277599119,1cyclictest3761333-21irqcore08:05:161
370277599118,2cyclictest3944673-21kthreadcore11:00:171
370277599117,3cyclictest3993876-21kworker/u8:2+flush-259:012:00:141
370277599107,2cyclictest3792643-21kthreadcore08:35:161
370277599106,2cyclictest0-21swapper/109:15:001
37027759995,2cyclictest3827551-21sh09:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional