You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 01:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sat Apr 11, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2999015994946,2cyclictest3065392-21kworker/u8:1+events_unbound08:30:251
2999011994640,4cyclictest3201067-21diskstats10:25:160
2999011994238,3cyclictest2983725-21kworker/u8:0+flush-259:007:40:200
2999022994036,3cyclictest3004018-21kworker/u8:2+flush-259:007:30:183
2999018993732,4cyclictest3004018-21kworker/u8:2+flush-259:009:05:222
2999011993731,4cyclictest3159448-21latency_hist09:45:010
2999018993630,4cyclictest3279837-21/usr/sbin/munin11:40:122
2999018993630,4cyclictest3004018-21kworker/u8:2+flush-259:008:15:172
2999011993631,3cyclictest252-21systemd-journal10:40:000
2999018993531,3cyclictest3174897-21kworker/u8:0+flush-259:011:10:012
2999018993429,3cyclictest3205780-21kworker/u8:3+flush-259:011:55:212
2999015993431,2cyclictest3004018-21kworker/u8:2+flush-259:009:10:311
2999022993327,4cyclictest3025376-21/usr/sbin/munin07:35:163
2999018993226,4cyclictest252-21systemd-journal07:36:502
2999015993223,8cyclictest3128519-21kworker/u8:0+flush-259:009:30:221
2999011993127,3cyclictest509-21rs:main0
2999011993127,3cyclictest509-21rs:main0
2999015993026,3cyclictest3004018-21kworker/u8:2+flush-259:008:25:231
2999011993026,3cyclictest3113273-21apt-get09:00:120
2999011993024,4cyclictest3009234-21apt-get07:20:000
2999011993024,4cyclictest252-21systemd-journal09:28:510
2999022992923,4cyclictest3179094-21ntpq10:00:213
2999018992926,2cyclictest2983725-21kworker/u8:0+flush-259:007:55:172
2999015992824,3cyclictest3274700-21apt-get11:35:111
2999015992823,3cyclictest252-21systemd-journal11:07:511
2999022992724,2cyclictest3118808-21kworker/u8:3+flush-259:009:10:153
2999018992723,3cyclictest3128519-21kworker/u8:0+events_unbound09:35:182
2999018992722,4cyclictest3065392-21kworker/u8:1+flush-259:008:30:172
2999018992722,3cyclictest3341670-21gpgv12:40:002
2999015992724,2cyclictest3065392-21kworker/u8:1+flush-259:008:50:191
2999011992724,2cyclictest3004018-21kworker/u8:2+flush-259:007:30:260
2999011992723,3cyclictest3004018-21kworker/u8:2+flush-259:009:10:230
2999011992723,2cyclictest3004018-21kworker/u8:2+events_unbound07:35:170
2999011992720,5cyclictest3086067-21ntpq08:30:230
2999022992620,4cyclictest3009468-21cat07:20:003
2999022992620,4cyclictest2998941-21latency_hist07:10:003
2999015992623,2cyclictest3138782-21kworker/u8:1+events_unbound10:30:181
2999015992623,2cyclictest3004018-21kworker/u8:2+flush-259:008:10:161
2999015992623,2cyclictest2940824-21kworker/u8:1+events_unbound07:15:171
2999015992621,4cyclictest3336643-21apt-get12:35:131
2999015992621,3cyclictest252-21systemd-journal11:34:511
2999011992622,3cyclictest3242649-21kworker/u8:1+events_unbound11:25:130
2999011992622,3cyclictest3205780-21kworker/u8:3+flush-259:012:25:000
2999011992622,3cyclictest2983725-21kworker/u8:0+events_unbound08:10:130
2999011992620,4cyclictest3232435-21base6410:55:000
2999011992619,5cyclictest3168889-21ntpq09:50:220
2999022992519,4cyclictest3149392-21apt-get09:35:123
2999018992521,3cyclictest3205780-21kworker/u8:3+flush-259:011:30:002
2999018992521,3cyclictest3004018-21kworker/u8:2+flush-259:009:25:202
2999018992520,3cyclictest3004018-21kworker/u8:2+flush-259:008:25:152
2999015992522,2cyclictest3258354-21kworker/u8:2+events_unbound11:40:121
2999015992522,2cyclictest3242649-21kworker/u8:1+events_unbound11:10:151
2999015992521,3cyclictest3200906-21apt-get10:25:141
2999015992521,3cyclictest3004018-21kworker/u8:2+flush-259:008:15:161
2999011992521,3cyclictest3092033-21kworker/u8:0+events_unbound08:55:130
2999011992519,4cyclictest3273135-21ntpq11:30:230
2999022992421,2cyclictest3326283-21kworker/u8:0+events_unbound12:35:203
2999022992418,4cyclictest3326050-21latency_hist12:25:003
2999022992418,4cyclictest252-21systemd-journal08:27:513
2999018992420,3cyclictest3138782-21kworker/u8:1+flush-259:010:24:592
2999018992418,4cyclictest252-21systemd-journal09:44:592
2999015992422,1cyclictest3004018-21kworker/u8:2+events_unbound07:55:141
2999015992420,3cyclictest3020261-21apt-get07:30:131
2999011992419,4cyclictest3174897-21kworker/u8:0+flush-259:011:00:210
2999011992417,5cyclictest3226325-21apt-get10:50:010
2999011992417,5cyclictest3194650-21ntpq10:15:220
2999022992316,5cyclictest3320885-21latency_hist12:20:003
2999018992319,3cyclictest3242649-21kworker/u8:1+flush-259:011:20:212
2999018992318,4cyclictest3004018-21kworker/u8:2+flush-259:009:00:242
2999018992318,4cyclictest3004018-21kworker/u8:2+flush-259:008:15:012
2999018992316,5cyclictest3206182-21diskstats10:30:132
2999015992321,2cyclictest3174897-21kworker/u8:0+events_unbound10:10:231
2999015992320,2cyclictest3138782-21kworker/u8:1+flush-259:010:20:251
2999015992320,2cyclictest3138782-21kworker/u8:1+events_unbound09:56:511
2999015992317,4cyclictest3299439-21ntpq11:55:211
2999015992317,4cyclictest252-21systemd-journal12:09:591
2999011992320,2cyclictest3268869-21kworker/u8:0+flush-259:011:35:230
2999011992319,3cyclictest3004018-21kworker/u8:2+events_unbound08:15:200
2999022992218,3cyclictest3242649-21kworker/u8:1+flush-259:011:20:263
2999018992217,4cyclictest3153431-21kworker/u8:2+flush-259:009:50:162
2999018992217,4cyclictest3118808-21kworker/u8:3+flush-259:009:10:162
2999015992219,3cyclictest3138782-21kworker/u8:1+events_unbound10:03:491
2999015992219,2cyclictest3331501-21apt-get12:30:111
2999015992219,2cyclictest3092033-21kworker/u8:0+flush-259:008:55:181
2999015992219,2cyclictest3092033-21kworker/u8:0+events_unbound08:45:241
2999015992219,2cyclictest3004018-21kworker/u8:2+events_unbound07:20:201
2999015992219,2cyclictest2983725-21kworker/u8:0+events_unbound08:05:231
2999015992218,3cyclictest3174897-21kworker/u8:0+events_unbound10:50:021
2999011992219,2cyclictest3284684-21kworker/u8:1+events_unbound11:50:220
2999011992219,2cyclictest3205780-21kworker/u8:3+events_unbound11:15:180
2999011992219,2cyclictest3174897-21kworker/u8:0+events_unbound11:05:230
2999011992218,3cyclictest3242649-21kworker/u8:1+events_unbound11:20:250
2999011992218,3cyclictest3242649-21kworker/u8:1+events_unbound11:11:510
2999011992218,3cyclictest3138782-21kworker/u8:1+flush-259:010:20:210
2999022992118,2cyclictest3205780-21kworker/u8:3+events_unbound11:50:153
2999022992118,2cyclictest3056010-21kworker/u8:3+flush-259:008:05:173
2999022992117,3cyclictest3295158-21kworker/u8:4+events_unbound12:05:203
2999022992117,3cyclictest3242649-21kworker/u8:1+events_unbound11:25:193
2999022992117,3cyclictest3205780-21kworker/u8:3+flush-259:011:45:213
2999022992117,3cyclictest3065392-21kworker/u8:1+events_unbound08:50:233
2999022992116,3cyclictest3174897-21kworker/u8:0+flush-259:010:40:173
2999022992115,4cyclictest3185598-21diskstats10:10:133
2999018992116,4cyclictest2940824-21kworker/u8:1+flush-259:007:15:212
2999015992118,2cyclictest3174897-21kworker/u8:0+flush-259:010:40:521
2999015992117,3cyclictest3205780-21kworker/u8:3+events_unbound11:15:521
2999015992117,3cyclictest3118808-21kworker/u8:3+events_unbound09:39:501
2999015992115,4cyclictest3138754-21latency_hist09:25:011
2999011992118,2cyclictest3295158-21kworker/u8:4+events_unbound12:15:190
2999011992118,2cyclictest3174897-21kworker/u8:0+events_unbound10:42:500
2999011992118,2cyclictest3004018-21kworker/u8:2+events_unbound08:25:180
2999011992117,3cyclictest3231951-21gpgv10:55:000
2999011992117,3cyclictest3205780-21kworker/u8:3+flush-259:011:56:210
2999011992115,4cyclictest3091131-21ntpq08:35:230
2999022992017,2cyclictest3174897-21kworker/u8:0+events_unbound10:50:173
2999022992016,3cyclictest3295158-21kworker/u8:4+events_unbound12:25:163
2999022992016,3cyclictest3205780-21kworker/u8:3+flush-259:011:15:163
2999022992016,3cyclictest3004018-21kworker/u8:2+events_unbound08:42:523
2999018992016,3cyclictest3284684-21kworker/u8:1+flush-259:012:05:012
2999015992017,2cyclictest3065392-21kworker/u8:1+flush-259:008:20:211
2999015992016,3cyclictest3174897-21kworker/u8:0+events_unbound10:55:171
2999015992016,3cyclictest3153431-21kworker/u8:2+flush-259:009:51:071
2999015992016,3cyclictest3004018-21kworker/u8:2+flush-259:009:00:521
2999015992016,3cyclictest3004018-21kworker/u8:2+flush-259:007:35:251
2999015992014,4cyclictest252-21systemd-journal09:47:511
2999015992013,6cyclictest3019100-21ntpq07:25:221
2999011992017,2cyclictest3179996-21cron10:04:590
2999011992017,2cyclictest3092033-21kworker/u8:0+flush-259:008:45:210
2999011992017,2cyclictest3004018-21kworker/u8:2+events_unbound07:27:510
2999011992016,3cyclictest3138782-21kworker/u8:1+events_unbound09:45:140
2999011992016,3cyclictest2983725-21kworker/u8:0+events_unbound07:50:180
2999022991915,3cyclictest3295158-21kworker/u8:4+flush-259:012:10:143
2999018991915,3cyclictest3056010-21kworker/u8:3+flush-259:008:05:182
2999018991913,4cyclictest3169969-21/usr/sbin/munin09:55:152
2999015991916,2cyclictest3004018-21kworker/u8:2+flush-259:007:45:211
2999015991915,3cyclictest507-21in:imuxsock11:25:001
2999015991915,3cyclictest3284684-21kworker/u8:1+events_unbound12:27:521
2999015991915,3cyclictest3118808-21kworker/u8:3+events_unbound09:26:521
2999015991915,3cyclictest3004018-21kworker/u8:2+events_unbound09:05:271
2999011991916,2cyclictest2940824-21kworker/u8:1+events_unbound07:10:170
2999011991915,3cyclictest3295158-21kworker/u8:4+flush-259:012:10:190
2999011991915,3cyclictest3284684-21kworker/u8:1+flush-259:012:28:260
2999011991915,3cyclictest3284684-21kworker/u8:1+events_unbound12:09:490
2999011991915,3cyclictest3174897-21kworker/u8:0+flush-259:010:10:510
2999022991815,2cyclictest3274059-21sh11:35:003
2999022991815,2cyclictest3004018-21kworker/u8:2+events_unbound07:20:153
2999022991814,3cyclictest3065392-21kworker/u8:1+events_unbound08:30:173
2999018991814,3cyclictest3295158-21kworker/u8:4+flush-259:012:16:552
2999018991814,3cyclictest3004018-21kworker/u8:2+flush-259:007:30:202
2999018991813,4cyclictest3205780-21kworker/u8:3+flush-259:010:35:222
2999018991813,4cyclictest3174897-21kworker/u8:0+flush-259:010:45:252
2999015991815,2cyclictest3138782-21kworker/u8:1+events_unbound10:05:141
2999015991815,2cyclictest2983725-21kworker/u8:0+flush-259:007:40:101
2999015991814,3cyclictest3205780-21kworker/u8:3+events_unbound11:50:181
2999015991814,3cyclictest3205780-21kworker/u8:3+events_unbound10:35:211
2999011991815,2cyclictest3284684-21kworker/u8:1+events_unbound12:35:000
2999011991815,2cyclictest3056010-21kworker/u8:3+flush-259:008:10:010
2999011991815,2cyclictest3004018-21kworker/u8:2+events_unbound07:55:520
2999022991714,2cyclictest3258354-21kworker/u8:2+events_unbound11:40:183
2999022991714,2cyclictest2983725-21kworker/u8:0+flush-259:008:00:253
2999022991714,2cyclictest2983725-21kworker/u8:0+flush-259:008:00:253
2999022991713,3cyclictest3138782-21kworker/u8:1+events_unbound10:25:203
2999022991713,3cyclictest2940824-21kworker/u8:1+flush-259:007:10:233
2999022991713,2cyclictest3065392-21kworker/u8:1+flush-259:008:45:003
2999022991711,4cyclictest3210918-21latency_hist10:35:013
2999018991714,2cyclictest3295158-21kworker/u8:4+flush-259:012:20:202
2999018991714,2cyclictest3010347-21irqcore07:20:172
2999018991712,3cyclictest3128519-21kworker/u8:0+flush-259:009:30:242
2999018991712,3cyclictest252-21systemd-journal11:04:492
2999018991711,4cyclictest252-21systemd-journal08:20:492
2999015991713,3cyclictest3242649-21kworker/u8:1+flush-259:011:25:251
2999015991713,3cyclictest3118808-21kworker/u8:3+events_unbound09:41:521
2999015991713,3cyclictest3065392-21kworker/u8:1+events_unbound08:40:181
2999015991713,3cyclictest2983725-21kworker/u8:0+events_unbound08:00:301
2999015991713,3cyclictest2983725-21kworker/u8:0+events_unbound08:00:291
2999011991715,1cyclictest0-21swapper/008:45:000
2999011991714,2cyclictest60350irq/132-enp0s29f1:rx-010:30:210
2999011991713,3cyclictest3065392-21kworker/u8:1+events_unbound08:20:230
2999011991712,4cyclictest3205780-21kworker/u8:3+flush-259:012:00:160
2999011991712,3cyclictest3154272-21cron09:39:590
2999022991613,2cyclictest3118808-21kworker/u8:3+flush-259:009:25:243
2999022991613,2cyclictest3030985-21irqcore07:40:163
2999018991613,2cyclictest3333791-21kthreadcore12:30:172
2999015991613,2cyclictest3174897-21kworker/u8:0+flush-259:010:45:201
2999015991612,3cyclictest3315987-21apt-get12:15:121
2999015991612,3cyclictest3295158-21kworker/u8:4+events_unbound12:10:221
2999015991612,3cyclictest3138782-21kworker/u8:1+flush-259:010:17:001
2999022991512,2cyclictest3295158-21kworker/u8:4+flush-259:011:55:203
2999022991512,2cyclictest3004018-21kworker/u8:2+events_unbound09:15:203
2999022991511,3cyclictest3205780-21kworker/u8:3+flush-259:010:57:013
2999022991511,3cyclictest3153431-21kworker/u8:2+events_unbound09:50:243
2999022991511,3cyclictest3118808-21kworker/u8:3+flush-259:009:08:223
2999022991511,3cyclictest2983725-21kworker/u8:0+flush-259:007:45:253
2999022991511,3cyclictest2983725-21kworker/u8:0+events_unbound07:25:203
2999022991510,4cyclictest3248073-21apt-get11:10:113
2999018991513,1cyclictest0-21swapper/210:45:002
2999018991511,3cyclictest3284684-21kworker/u8:1+flush-259:011:50:012
2999018991511,3cyclictest3274043-21apt-key11:35:012
2999018991511,3cyclictest3174897-21kworker/u8:0+flush-259:010:30:002
2999018991510,3cyclictest2940824-21kworker/u8:1+flush-259:007:10:172
2999018991510,3cyclictest252-21systemd-journal11:16:592
2999015991513,1cyclictest3004018-21kworker/u8:2+events_unbound08:35:201
2999015991512,2cyclictest3205780-21kworker/u8:3+flush-259:012:21:201
2999015991512,2cyclictest3004018-21kworker/u8:2+events_unbound09:15:151
2999015991512,2cyclictest2961471-21kworker/u8:4+flush-259:007:10:311
2999011991513,1cyclictest60350irq/132-enp0s29f1:rx-009:20:200
2999011991513,1cyclictest60350irq/132-enp0s29f1:rx-008:50:140
2999011991513,1cyclictest3185172-21sh10:10:000
2999011991512,2cyclictest3174868-21turbostat10:00:000
2999011991511,3cyclictest60350irq/132-enp0s29f1:rx-011:45:120
2999022991411,2cyclictest500-21systemd-logind10:09:593
2999022991411,2cyclictest3258354-21kworker/u8:2+events_unbound11:35:143
2999022991411,2cyclictest3118808-21kworker/u8:3+events_unbound09:40:163
2999022991410,3cyclictest3138782-21kworker/u8:1+events_unbound09:55:133
2999022991410,3cyclictest3004018-21kworker/u8:2+flush-259:007:50:273
2999022991410,2cyclictest3004018-21kworker/u8:2+flush-259:009:20:263
2999022991410,2cyclictest0-21swapper/310:50:013
299901899149,3cyclictest3097686-21cat08:45:002
2999018991411,2cyclictest3112147-21ntp_kernel_pll_08:55:212
2999018991410,3cyclictest3138782-21kworker/u8:1+flush-259:009:45:172
2999015991411,2cyclictest3205780-21kworker/u8:3+events_unbound12:00:251
2999015991410,3cyclictest3285026-21apt-get11:45:121
2999011991412,1cyclictest60350irq/132-enp0s29f1:rx-009:30:100
2999011991412,1cyclictest60350irq/132-enp0s29f1:rx-009:15:240
2999011991412,1cyclictest60350irq/132-enp0s29f1:rx-007:20:230
2999011991411,2cyclictest3118409-21/usr/sbin/munin09:05:200
299902299138,4cyclictest252-21systemd-journal12:35:003
2999022991310,2cyclictest3174897-21kworker/u8:0+flush-259:011:05:193
2999022991310,2cyclictest3138782-21kworker/u8:1+flush-259:010:20:183
2999022991310,2cyclictest3138782-21kworker/u8:1+events_unbound09:45:273
2999022991310,2cyclictest3091541-21unixbench_multi08:35:263
299901899139,3cyclictest3138782-21kworker/u8:1+flush-259:010:18:562
299901899139,3cyclictest2983725-21kworker/u8:0+flush-259:007:25:252
299901899137,4cyclictest3004018-21kworker/u8:2+flush-259:008:00:192
299901899137,4cyclictest3004018-21kworker/u8:2+flush-259:008:00:182
2999018991311,1cyclictest3031583-21kthreadcore07:40:172
2999018991310,2cyclictest0-21swapper/210:50:182
2999018991310,2cyclictest0-21swapper/208:55:012
2999011991311,2cyclictest60350irq/132-enp0s29f1:rx-012:36:040
299902299128,3cyclictest3174897-21kworker/u8:0+events_unbound11:00:513
299901899129,2cyclictest3330227-21needreboot12:25:192
299901599129,2cyclictest3242150-21unixbench_multi11:00:281
2999015991210,1cyclictest3004018-21kworker/u8:2+events_unbound07:50:281
299902299119,1cyclictest0-21swapper/309:30:173
299902299117,3cyclictest3174897-21kworker/u8:0+events_unbound10:35:263
299902299117,3cyclictest3174897-21kworker/u8:0+events_unbound10:15:223
299901899108,1cyclictest0-21swapper/210:15:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional