You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 04:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun Jun 14, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3003166994639,5cyclictest3335457-21ntpq00:25:211
3003168994339,3cyclictest3131977-21kworker/u8:0+flush-259:021:40:202
3003168994338,3cyclictest3221664-21kworker/u8:1+events_unbound00:00:222
3003168993936,2cyclictest3163268-21kworker/u8:1+flush-259:022:10:182
3003168993935,3cyclictest3131977-21kworker/u8:0+events_unbound21:30:202
3003166993933,4cyclictest3200368-21base6422:20:001
3003166993933,4cyclictest3127201-21latency_hist21:10:011
3003172993831,5cyclictest3210920-21latency_hist22:30:003
3003168993734,2cyclictest3221664-21kworker/u8:1+events_unbound23:10:212
3003168993632,3cyclictest3309759-21kworker/u8:2+flush-259:000:35:232
3003168993629,5cyclictest3070561-21latency_hist20:15:012
3003166993528,5cyclictest3215658-21ntpq22:30:221
3003161993431,2cyclictest3195076-21kworker/u8:0+flush-259:022:55:150
3003161993429,4cyclictest3110842-21ntpq20:50:220
3003172993228,3cyclictest3132333-21latency_hist21:15:013
3003168993229,2cyclictest3116919-21kworker/u8:3+events_unbound21:35:172
3003168993228,3cyclictest3242234-21kworker/u8:3+events_unbound23:05:202
3003168993228,3cyclictest3116919-21kworker/u8:3+flush-259:021:20:162
3003168993128,2cyclictest3163268-21kworker/u8:1+flush-259:022:25:002
3003168993128,2cyclictest3163268-21kworker/u8:1+flush-259:022:20:002
3003168993125,4cyclictest3242482-21apt-get23:00:112
3003168993125,4cyclictest3242482-21apt-get23:00:102
3003161993126,4cyclictest3065369-21latency_hist20:10:010
3003172993025,4cyclictest3163268-21kworker/u8:1+flush-259:022:10:013
3003172993025,3cyclictest3023727-21apt-get19:30:033
3003168993027,2cyclictest3065604-21kworker/u8:1+flush-259:020:30:172
3003168993026,3cyclictest3221664-21kworker/u8:1+events_unbound23:30:142
3003168993026,3cyclictest3163268-21kworker/u8:1+events_unbound21:55:162
3003168993025,3cyclictest3013469-21kworker/u8:0+events_unbound19:40:212
3003168992926,2cyclictest3242234-21kworker/u8:3+events_unbound23:25:122
3003168992926,2cyclictest3003357-21kworker/u8:4+flush-259:020:40:152
3003168992926,2cyclictest3003357-21kworker/u8:4+flush-259:020:40:152
3003168992925,3cyclictest3309759-21kworker/u8:2+events_unbound00:25:182
3003168992925,3cyclictest3116919-21kworker/u8:3+flush-259:021:50:242
3003168992924,4cyclictest3221664-21kworker/u8:1+events_unbound22:45:192
300316199290,28cyclictest1-21systemd19:50:330
300316199290,27cyclictest1-21systemd22:53:320
3003168992825,2cyclictest3309759-21kworker/u8:2+events_unbound00:05:192
3003168992825,2cyclictest3195076-21kworker/u8:0+flush-259:022:40:242
3003168992824,3cyclictest3221664-21kworker/u8:1+events_unbound23:35:222
3003168992824,3cyclictest3184916-21kworker/u8:4+flush-259:022:35:242
3003166992823,3cyclictest3070788-21kworker/u8:3+events_unbound20:15:231
3003161992824,3cyclictest3190107-21apt-get22:10:090
3003172992723,3cyclictest3163268-21kworker/u8:1+events_unbound21:55:203
3003172992720,5cyclictest3023946-21cat19:30:013
3003168992724,2cyclictest3221664-21kworker/u8:1+flush-259:023:15:162
3003168992724,2cyclictest3003357-21kworker/u8:4+flush-259:019:50:212
3003168992723,3cyclictest3242234-21kworker/u8:3+flush-259:023:20:252
3003168992723,3cyclictest3013469-21kworker/u8:0+events_unbound19:30:212
3003172992622,3cyclictest3242234-21kworker/u8:3+flush-259:023:40:003
3003168992623,2cyclictest3309759-21kworker/u8:2+flush-259:000:25:012
3003168992623,2cyclictest3195076-21kworker/u8:0+flush-259:022:25:182
3003168992622,3cyclictest3065604-21kworker/u8:1+events_unbound20:55:252
3003166992620,4cyclictest3204911-21ntpq22:20:211
3003166992620,4cyclictest3159209-21/usr/sbin/munin21:40:131
3003161992620,4cyclictest3039636-21latency_hist19:45:010
3003172992521,3cyclictest3163268-21kworker/u8:1+flush-259:021:40:333
3003168992521,3cyclictest3232145-21kworker/u8:2+events_unbound22:50:142
3003168992521,3cyclictest3013469-21kworker/u8:0+flush-259:019:35:212
3003161992522,2cyclictest3242234-21kworker/u8:3+events_unbound23:05:180
3003161992521,3cyclictest3294444-21apt-get23:50:110
3003172992420,3cyclictest335557-21systemd-journal20:33:323
3003168992421,2cyclictest3164372-21apt-get21:45:112
3003168992421,2cyclictest3116919-21kworker/u8:3+flush-259:022:00:252
3003168992421,2cyclictest3116919-21kworker/u8:3+events_unbound21:00:222
3003168992420,3cyclictest3283901-21kworker/u8:2+events_unbound23:45:132
3003168992420,3cyclictest3221664-21kworker/u8:1+events_unbound00:11:342
3003166992420,3cyclictest3116919-21kworker/u8:3+events_unbound22:00:231
3003166992420,2cyclictest335557-21systemd-journal22:54:591
3003166992419,3cyclictest335557-21systemd-journal20:55:011
3003161992420,3cyclictest509-21rs:main0
3003172992319,3cyclictest3116919-21kworker/u8:3+flush-259:021:05:003
3003172992317,5cyclictest3137036-21ntpq21:15:223
3003168992320,2cyclictest3294195-21kworker/u8:4+events_unbound23:50:232
3003168992319,3cyclictest3023968-21store19:30:022
3003166992319,3cyclictest3195076-21kworker/u8:0+flush-259:022:25:211
3003166992319,3cyclictest2987377-21kworker/u8:2+flush-259:020:05:261
3003166992316,5cyclictest3101487-21latency_hist20:45:011
3003166992316,5cyclictest3101487-21latency_hist20:45:001
3003161992319,3cyclictest3258389-21apt-get23:15:110
3003161992319,3cyclictest3200310-21gpgv22:20:000
3003161992318,4cyclictest3325569-21apt-get00:20:010
3003161992318,4cyclictest3100630-21ntpq20:40:230
3003161992318,4cyclictest3100630-21ntpq20:40:220
3003161992317,5cyclictest3200197-21apt-get22:20:010
3003161992317,4cyclictest3331156-21latency_hist00:25:010
3003172992219,2cyclictest3221664-21kworker/u8:1+flush-259:023:25:173
3003168992219,2cyclictest3065604-21kworker/u8:1+events_unbound21:13:132
3003168992218,3cyclictest3221664-21kworker/u8:1+events_unbound23:58:422
3003168992218,3cyclictest3065604-21kworker/u8:1+events_unbound20:36:342
3003168992217,3cyclictest509-21rs:main2
3003168992217,3cyclictest3131977-21kworker/u8:0+events_unbound21:25:142
3003166992219,2cyclictest3195076-21kworker/u8:0+flush-259:022:55:211
3003166992218,3cyclictest3283901-21kworker/u8:2+flush-259:023:45:171
3003166992218,3cyclictest3221664-21kworker/u8:1+events_unbound23:25:171
3003166992218,3cyclictest3070788-21kworker/u8:3+flush-259:020:25:251
3003166992218,3cyclictest3049954-21kworker/u8:0+flush-259:019:55:221
3003166992217,3cyclictest3309759-21kworker/u8:2+flush-259:000:30:161
3003166992217,3cyclictest3257700-21apt-get23:15:021
3003166992215,5cyclictest335557-21systemd-journal00:17:321
3003168992118,2cyclictest3003120-21kworker/u8:3+flush-259:019:10:152
3003168992114,2cyclictest3003357-21kworker/u8:4+events_unbound20:20:162
3003166992117,3cyclictest3221664-21kworker/u8:1+flush-259:023:30:231
3003166992117,3cyclictest3221664-21kworker/u8:1+flush-259:000:00:211
3003166992117,3cyclictest3116919-21kworker/u8:3+events_unbound21:00:181
3003161992118,2cyclictest3148234-21cron21:30:000
3003161992116,4cyclictest335557-21systemd-journal23:40:320
3003161992116,4cyclictest3121216-21ntpq21:00:230
3003172992018,1cyclictest0-21swapper/323:15:003
3003172992018,1cyclictest0-21swapper/300:29:593
3003172992015,4cyclictest335557-21systemd-journal23:05:333
3003172992015,3cyclictest335557-21systemd-journal22:53:323
3003168992017,2cyclictest3221664-21kworker/u8:1+flush-259:023:40:182
3003168992017,2cyclictest3184709-21kworker/u8:2+flush-259:022:05:232
3003168992017,2cyclictest3065604-21kworker/u8:1+events_unbound20:50:232
3003168992017,2cyclictest3003357-21kworker/u8:4+events_unbound20:45:202
3003168992017,2cyclictest3003357-21kworker/u8:4+events_unbound20:45:192
3003168992016,2cyclictest3195076-21kworker/u8:0+flush-259:022:30:182
3003168992014,4cyclictest3320607-21base6400:15:012
3003166992017,2cyclictest3179576-21sh22:00:001
3003166992016,3cyclictest3003120-21kworker/u8:3+flush-259:019:10:211
3003161992017,2cyclictest3065604-21kworker/u8:1+flush-259:020:50:000
3003161992017,2cyclictest3065604-21kworker/u8:1+flush-259:020:50:000
3003172991915,3cyclictest335557-21systemd-journal19:50:323
3003172991915,3cyclictest3116919-21kworker/u8:3+flush-259:021:05:253
3003172991914,4cyclictest335557-21systemd-journal23:47:453
3003172991913,4cyclictest3220776-21ntpq22:35:223
3003172991913,4cyclictest3091581-21diskstats20:35:143
3003168991912,5cyclictest3003105-21latency_hist19:10:012
3003166991914,4cyclictest3116919-21kworker/u8:3+events_unbound21:20:201
3003161991916,2cyclictest3309759-21kworker/u8:2+flush-259:000:35:000
3003161991913,5cyclictest335557-21systemd-journal19:33:310
3003172991814,3cyclictest3116919-21kworker/u8:3+flush-259:021:50:003
3003172991814,2cyclictest3153418-21kworker/u8:2+flush-259:021:35:003
3003168991815,2cyclictest3065604-21kworker/u8:1+events_unbound20:25:132
3003168991815,2cyclictest3003357-21kworker/u8:4+events_unbound19:20:122
3003168991811,5cyclictest335557-21systemd-journal20:02:322
3003168991810,5cyclictest335557-21systemd-journal21:20:002
3003166991815,2cyclictest3003357-21kworker/u8:4+events_unbound20:20:241
3003166991814,3cyclictest3221664-21kworker/u8:1+flush-259:023:55:161
3003166991814,1cyclictest0-21swapper/121:35:011
3003166991813,3cyclictest3309759-21kworker/u8:2+flush-259:000:15:011
3003161991814,3cyclictest3304791-21/usr/sbin/munin00:00:140
3003161991814,3cyclictest3195076-21kworker/u8:0+flush-259:022:35:260
3003161991814,3cyclictest3116919-21kworker/u8:3+flush-259:021:05:270
3003161991813,4cyclictest3039901-21apt-get19:45:110
3003161991810,6cyclictest335557-21systemd-journal22:35:000
3003172991712,4cyclictest3003357-21kworker/u8:4+flush-259:019:50:013
3003168991714,2cyclictest3122297-21kworker/u8:2+events_unbound21:05:172
300316699172,8cyclictest3268415-21munin-run23:25:001
3003166991713,3cyclictest3184916-21kworker/u8:4+flush-259:022:35:151
3003166991713,3cyclictest3013469-21kworker/u8:0+events_unbound19:30:151
3003166991713,2cyclictest3014096-21irqcore19:20:151
3003166991710,5cyclictest335557-21systemd-journal19:40:001
300316699170,14cyclictest1-21systemd21:00:001
3003161991714,2cyclictest60350irq/132-enp0s29f1:rx-020:55:240
3003161991714,1cyclictest0-21swapper/021:15:000
3003161991712,4cyclictest3195076-21kworker/u8:0+flush-259:022:25:160
3003161991711,4cyclictest3055120-21latency_hist20:00:000
3003172991613,2cyclictest3309759-21kworker/u8:2+flush-259:000:10:273
3003172991611,4cyclictest3075774-21latency_hist20:20:003
3003172991610,4cyclictest335557-21systemd-journal19:45:003
3003168991613,2cyclictest3309759-21kworker/u8:2+flush-259:000:30:182
3003168991613,2cyclictest2987377-21kworker/u8:2+events_unbound19:55:102
3003166991612,3cyclictest3013469-21kworker/u8:0+flush-259:019:40:251
3003166991610,4cyclictest335557-21systemd-journal21:13:311
3003166991610,4cyclictest3320637-21kworker/u8:3+events_unbound00:20:231
300316199165,9cyclictest3030292-21sed19:35:180
3003161991613,2cyclictest60350irq/132-enp0s29f1:rx-023:55:570
3003161991613,2cyclictest60350irq/132-enp0s29f1:rx-023:45:250
3003161991613,2cyclictest60350irq/132-enp0s29f1:rx-023:04:480
3003161991613,2cyclictest60350irq/132-enp0s29f1:rx-023:04:470
3003161991613,2cyclictest60350irq/132-enp0s29f1:rx-022:05:140
3003161991613,2cyclictest60350irq/132-enp0s29f1:rx-020:37:100
3003161991613,2cyclictest60350irq/132-enp0s29f1:rx-020:20:180
3003161991613,2cyclictest60350irq/132-enp0s29f1:rx-000:25:190
300316199160,14cyclictest509-21rs:main0
3003172991513,1cyclictest0-21swapper/320:45:003
3003172991513,1cyclictest0-21swapper/320:44:593
3003172991512,2cyclictest3300062-21grep23:55:173
3003172991512,1cyclictest0-21swapper/300:20:013
3003172991511,3cyclictest3226993-21/usr/sbin/munin22:45:153
3003172991510,3cyclictest335557-21systemd-journal22:19:553
3003168991511,3cyclictest3070788-21kworker/u8:3+events_unbound20:15:152
300316699159,4cyclictest335557-21systemd-journal19:18:321
3003166991511,3cyclictest507-21in:imuxsock20:34:591
3003166991511,3cyclictest3252337-21kworker/u8:0+flush-259:023:10:211
3003161991513,1cyclictest60350irq/132-enp0s29f1:rx-023:10:210
3003161991513,1cyclictest60350irq/132-enp0s29f1:rx-020:28:030
3003161991513,1cyclictest60350irq/132-enp0s29f1:rx-020:10:150
3003161991513,1cyclictest60350irq/132-enp0s29f1:rx-020:01:240
3003161991512,2cyclictest61150irq/133-enp0s29f1:tx-023:20:130
3003161991512,2cyclictest61150irq/133-enp0s29f1:tx-019:20:240
3003161991512,2cyclictest60350irq/132-enp0s29f1:rx-022:00:510
3003161991512,2cyclictest60350irq/132-enp0s29f1:rx-021:40:150
3003161991512,2cyclictest60350irq/132-enp0s29f1:rx-021:38:390
3003161991512,2cyclictest60350irq/132-enp0s29f1:rx-020:34:350
3003161991512,2cyclictest60350irq/132-enp0s29f1:rx-020:18:110
3003161991512,2cyclictest60350irq/132-enp0s29f1:rx-019:25:120
3003161991512,2cyclictest60350irq/132-enp0s29f1:rx-019:15:010
3003161991512,2cyclictest3273590-21systemd-run23:30:000
3003161991510,4cyclictest3195076-21kworker/u8:0+flush-259:022:40:250
300317299149,3cyclictest335557-21systemd-journal20:45:323
300317299149,3cyclictest335557-21systemd-journal20:45:313
300317299148,4cyclictest335557-21systemd-journal23:23:323
3003172991411,2cyclictest3309713-21sh00:05:003
3003172991411,2cyclictest3138610-21irqcore21:20:163
300316899149,3cyclictest3060943-21grep20:05:172
3003168991410,3cyclictest3003357-21kworker/u8:4+events_unbound19:46:572
3003166991411,2cyclictest507-21in:imuxsock20:50:011
3003166991411,2cyclictest507-21in:imuxsock20:50:001
3003166991411,2cyclictest0-21swapper/119:30:021
3003161991413,1cyclictest60350irq/132-enp0s29f1:rx-000:05:200
3003161991412,1cyclictest61150irq/133-enp0s29f1:tx-023:30:130
3003161991412,1cyclictest60350irq/132-enp0s29f1:rx-000:10:430
3003161991411,2cyclictest60350irq/132-enp0s29f1:rx-021:45:200
3003161991411,2cyclictest60350irq/132-enp0s29f1:rx-021:21:100
3003161991411,2cyclictest60350irq/132-enp0s29f1:rx-000:35:160
3003161991410,3cyclictest3153753-21apt-key21:35:010
300317299139,2cyclictest0-21swapper/319:15:193
3003172991311,1cyclictest0-21swapper/323:55:013
3003172991311,1cyclictest0-21swapper/321:55:013
3003172991310,2cyclictest3288616-21unixbench_singl23:40:243
3003172991310,2cyclictest2971-21cron20:15:003
300317299130,12cyclictest500-21systemd-logind20:30:003
300316699139,3cyclictest3184709-21kworker/u8:2+flush-259:022:05:331
300316699138,4cyclictest507-21in:imuxsock22:45:001
300316699136,5cyclictest335557-21systemd-journal22:50:001
300316699131,10cyclictest3158985-21idleruntime-cro21:40:011
300316199139,3cyclictest500-21systemd-logind22:00:010
300316199139,2cyclictest60350irq/132-enp0s29f1:rx-021:50:170
3003161991311,1cyclictest60350irq/132-enp0s29f1:rx-022:45:150
3003161991310,2cyclictest60350irq/132-enp0s29f1:rx-023:35:140
300317299129,2cyclictest0-21swapper/320:05:253
300317299126,5cyclictest3314851-21latency_hist00:10:013
300317299126,4cyclictest3111742-21cron20:54:593
3003172991210,1cyclictest3195039-21cron22:14:593
300316899128,3cyclictest3003357-21kworker/u8:4+events_unbound19:18:402
300316699127,4cyclictest3049954-21kworker/u8:0+events_unbound20:10:201
300316699126,4cyclictest3058747-21cut20:00:161
3003166991210,1cyclictest301rcuc/120:35:191
300317299118,2cyclictest3345815-21ntp_offset00:35:223
300317299118,2cyclictest3221664-21kworker/u8:1+flush-259:023:15:153
300317299118,2cyclictest0-21swapper/323:05:003
300317299118,2cyclictest0-21swapper/323:04:593
300317299116,4cyclictest3200857-21munin-node22:20:123
300316699118,2cyclictest3137433-21unixbench_multi21:15:271
300316699118,1cyclictest0-21swapper/123:00:121
300316699118,1cyclictest0-21swapper/123:00:121
300316699117,3cyclictest3116919-21kworker/u8:3+events_unbound21:50:221
300316699117,2cyclictest3280000-21kthreadcore23:35:181
300317299107,2cyclictest3055511-21cpuspeed_turbos20:00:113
300317299106,3cyclictest3309759-21kworker/u8:2+flush-259:000:30:153
300316699108,1cyclictest0-21swapper/123:40:141
300316699106,3cyclictest3131977-21kworker/u8:0+events_unbound21:45:141
300316699105,3cyclictest3299517-21cat23:55:011
30031729995,2cyclictest0-21swapper/319:15:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional