You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 15:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Dec 10, 2025 12:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
399040721920,3sleep3586-21kworker/3:2-events08:26:103
3910482996152,6cyclictest3941095-21ntpq07:36:140
3910485995951,6cyclictest3990930-21apt-get08:26:201
3910482995039,8cyclictest4000842-21ntpq08:36:140
3910482994735,9cyclictest282-21systemd-journal11:06:000
3910482994638,6cyclictest282-21systemd-journal08:15:000
3910485994336,5cyclictest3890812-21kworker/u8:1+flush-8:008:01:211
3910485994334,7cyclictest282-21systemd-journal09:23:001
3910482994338,3cyclictest3981693-21kworker/u8:0+events_unbound11:36:080
3910482994337,4cyclictest3890812-21kworker/u8:1+flush-8:007:16:060
3910485994235,5cyclictest3981656-21latency_hist08:20:011
3910485994235,5cyclictest282-21systemd-journal10:00:001
3910485994232,7cyclictest4076375-21latency_hist09:55:021
3910482994238,3cyclictest3858451-21kworker/u8:2+flush-8:007:56:200
3910485994131,8cyclictest4175053-21ntpq11:31:141
3910482994132,6cyclictest4136130-21latency_hist10:55:020
3910482994130,9cyclictest282-21systemd-journal07:15:010
3910485994035,4cyclictest3890812-21kworker/u8:1+flush-8:008:31:051
3910485994032,6cyclictest4111450-21kworker/u8:1+flush-8:011:21:061
3910485994032,6cyclictest17325-21apt-get12:10:591
3910488993927,9cyclictest282-21systemd-journal07:40:012
3910485993931,6cyclictest3981965-21/usr/sbin/munin08:21:111
3910482993932,5cyclictest3981693-21kworker/u8:0+flush-8:008:31:220
3910482993930,7cyclictest3962186-21/usr/sbin/munin08:01:180
3910482993922,14cyclictest4090870-21grep10:06:330
3910482993833,4cyclictest4026901-21kworker/u8:1+flush-8:009:41:110
3910482993833,4cyclictest4026901-21kworker/u8:1+flush-8:009:41:100
3910482993831,5cyclictest4086532-21kworker/u8:2+flush-8:011:01:250
3910482993831,5cyclictest4076630-21kworker/u8:3+events_unbound09:56:130
3910482993830,6cyclictest4186340-21apt-get11:46:000
3910482993829,7cyclictest4164940-21ntpq11:21:140
3910482993828,7cyclictest3976988-21/usr/sbin/munin08:16:150
160112380,4chrt281rcuc/112:06:131
3910485993730,5cyclictest4136453-21apt-get10:56:011
3910485993730,5cyclictest3951121-21ntpq07:46:151
3910482993731,4cyclictest3996991-21kworker/u8:2+flush-8:008:56:310
3910482993729,6cyclictest4035791-21kworker/u8:2+flush-8:009:26:150
3910482993729,5cyclictest4154996-21ntpq11:11:120
3910485993629,5cyclictest4156215-21apt-get11:16:001
3910485993626,7cyclictest4106494-21latency_hist10:25:011
3910485993624,9cyclictest4011569-21latency_hist08:50:011
3910482993629,5cyclictest3858451-21kworker/u8:2+flush-8:008:06:170
391014623622,9sleep10-21swapper/107:07:481
3910488993526,7cyclictest282-21systemd-journal12:24:592
3910485993530,3cyclictest3981693-21kworker/u8:0+events_unbound09:11:111
3910485993528,5cyclictest4111759-21apt-get10:30:591
3910485993528,5cyclictest4036551-21apt-get09:15:021
3910482993529,4cyclictest4111450-21kworker/u8:1+events_unbound11:56:180
3910482993529,4cyclictest3996991-21kworker/u8:2+events_unbound08:46:150
3910482993528,5cyclictest3890812-21kworker/u8:1+flush-8:007:21:230
391048299351,31cyclictest3952026-21unin-run07:50:000
3910488993430,3cyclictest4035791-21kworker/u8:2+events_unbound09:25:012
3910485993427,5cyclictest282-21systemd-journal12:30:051
3910482993427,4cyclictest1311-21kworker/u8:2+events_unbound11:51:230
3910482993427,4cyclictest1311-21kworker/u8:2+events_unbound11:51:230
3910482993329,3cyclictest3890812-21kworker/u8:1+flush-8:007:26:060
39110052320,4sleep20-21swapper/207:11:052
3910488993225,5cyclictest4186012-21cp11:45:002
3910485993222,8cyclictest3914486-21ntpq07:11:141
3910482993229,1cyclictest3981693-21kworker/u8:0+events_unbound09:36:150
3910482993226,4cyclictest4026901-21kworker/u8:1+flush-8:009:46:200
3910482993225,5cyclictest4186251-21kworker/u8:0+events_unbound12:31:130
3910482993225,5cyclictest12681-21grep12:06:050
3910482993224,5cyclictest4101306-21latency_hist10:20:010
39082662324,22sleep00-21swapper/007:06:110
3910485993126,3cyclictest3917656-21aten2_r5power_e07:16:031
3910485993124,5cyclictest4035791-21kworker/u8:2+events_unbound09:26:151
3910485993123,6cyclictest3922582-21apt-get07:21:021
3910482993123,4cyclictest3947034-21true07:45:010
3910482993121,5cyclictest0-21swapper/010:36:010
3910482993114,11cyclictest45750irq/130-enp3s0-TxRx-309:31:000
41527452300,6sleep20-21swapper/211:11:082
39613202300,5sleep20-21swapper/207:56:202
3910488993020,8cyclictest4165798-21apt-get11:25:002
3910485993026,2cyclictest0-21swapper/107:41:081
3910485993021,7cyclictest4166360-21apt-get11:26:001
3910482993026,3cyclictest4186251-21kworker/u8:0+flush-8:012:36:260
3910482993025,4cyclictest3996991-21kworker/u8:2+events_unbound08:51:190
3910482993024,4cyclictest6813-21kworker/u8:3+events_unbound12:01:090
3910482993022,6cyclictest3869035-21kworker/u8:0+flush-8:007:31:060
3910488992925,2cyclictest4037417-21fschecks_time09:16:062
3910485992924,4cyclictest4082381-21irqrtprio10:01:071
3910485992920,7cyclictest4091530-21apt-get10:11:011
3910485992920,6cyclictest282-21systemd-journal07:27:351
3910482992923,4cyclictest3981693-21kworker/u8:0+events_unbound11:31:020
3910482992920,5cyclictest0-21swapper/010:41:030
3910482992920,5cyclictest0-21swapper/010:41:020
3910482992916,11cyclictest0-21swapper/011:45:000
3910488992820,6cyclictest3996518-21apt-get08:35:002
3910488992820,6cyclictest282-21systemd-journal11:35:002
3910488992818,2cyclictest161rcu_preempt09:36:052
3910485992825,2cyclictest46269-21runrttasks12:36:241
3910485992825,2cyclictest2508-21aten2_r5power_c11:56:031
3910485992821,5cyclictest282-21systemd-journal07:55:491
391048299285,18cyclictest3976708-21kworker/0:2+events08:40:220
3910482992823,4cyclictest3981693-21kworker/u8:0+flush-8:011:16:210
3910482992823,4cyclictest3981693-21kworker/u8:0+flush-8:008:26:170
3910482992822,4cyclictest3981693-21kworker/u8:0+flush-8:009:51:060
3910482992822,4cyclictest3981693-21kworker/u8:0+flush-8:008:21:210
391048299282,18cyclictest610-21sshd09:21:000
3910488992721,4cyclictest4106132-21unixbench_multi10:21:222
3910488992719,1cyclictest161rcu_preempt10:41:162
3910488992719,1cyclictest161rcu_preempt10:41:162
3910488992710,2cyclictest0-21swapper/211:36:122
3910485992724,2cyclictest4096958-21cpuspeed_turbos10:16:061
3910485992723,2cyclictest0-21swapper/109:40:001
3910485992721,5cyclictest4111450-21kworker/u8:1+flush-8:012:01:151
391048299277,18cyclictest3976708-21kworker/0:2+events09:14:260
3910482992723,3cyclictest3996991-21kworker/u8:2+flush-8:009:01:210
3910482992722,3cyclictest6813-21kworker/u8:3+flush-8:012:16:100
391048299272,17cyclictest584-21snmpd09:16:020
3910482992720,5cyclictest3956023-21ntpq07:51:150
391048899269,8cyclictest0-21swapper/212:16:102
391048899262,4cyclictest0-21swapper/209:50:002
391048899260,9cyclictest4091780-21df_inode10:11:112
3910485992622,2cyclictest2180-21latency_hist11:55:011
3910485992622,2cyclictest2180-21latency_hist11:55:011
3910485992621,3cyclictest4122245-21irqcore10:41:121
3910485992621,3cyclictest4122245-21irqcore10:41:121
3910485992619,5cyclictest282-21systemd-journal09:08:011
3910485992616,7cyclictest282-21systemd-journal07:36:351
3910482992620,4cyclictest412-21systemd-logind10:32:210
3910482992620,4cyclictest4076630-21kworker/u8:3+flush-8:010:11:200
3910482992620,4cyclictest36429-21unixbench_multi12:26:210
3910482992620,4cyclictest36429-21unixbench_multi12:26:210
3910482992618,5cyclictest31849-21latency_hist12:25:010
3910482992616,7cyclictest4131168-21latency_hist10:50:000
391048899259,3cyclictest67122grep11:56:222
391048899252,6cyclictest0-21swapper/209:51:042
391048899252,6cyclictest0-21swapper/209:08:302
3910488992522,2cyclictest4140695-21unixbench_singl10:56:232
3910488992521,2cyclictest4100962-21unixbench_singl10:16:222
3910488992521,2cyclictest371rcuc/210:05:012
3910488992513,2cyclictest421rcuog/212:11:342
391048899250,9cyclictest4044748-21cut09:21:122
3910485992521,3cyclictest405-21dbus-daemon07:35:001
3910485992521,3cyclictest36447-21unixbench_multi12:26:211
3910485992521,3cyclictest36447-21unixbench_multi12:26:211
3910485992521,2cyclictest0-21swapper/111:01:001
3910485992513,9cyclictest4066798-21apt-get09:46:031
3910482992520,3cyclictest4076630-21kworker/u8:3+flush-8:010:21:110
391048899242,6cyclictest0-21swapper/211:07:532
391048899240,5cyclictest35975-21ntpq12:26:132
391048899240,5cyclictest35975-21ntpq12:26:132
391048899240,12cyclictest3917602-21apt-get07:16:032
3910485992420,3cyclictest30932-21needreboot12:21:111
3910485992420,2cyclictest0-21swapper/111:46:091
3910485992420,2cyclictest0-21swapper/109:41:211
3910485992420,2cyclictest0-21swapper/109:41:211
3910485992418,4cyclictest4002055-21apt-get08:41:031
391048299242,14cyclictest587-21runrttasks09:06:010
3910482992418,4cyclictest4168517-21kthreadcore11:26:120
3910482992418,4cyclictest4110420-21missed_timers10:26:120
3910482992415,5cyclictest0-21swapper/010:56:010
391048899239,3cyclictest0-21swapper/211:51:022
391048899239,3cyclictest0-21swapper/211:51:022
391048899237,2cyclictest161rcu_preempt10:31:152
391048899235,2cyclictest3924198-21grep07:21:122
391048899232,6cyclictest3955701-21kthreadcore07:51:122
391048899232,6cyclictest0-21swapper/210:08:492
391048899232,6cyclictest0-21swapper/208:45:342
391048899232,6cyclictest0-21swapper/208:29:172
391048899232,5cyclictest0-21swapper/208:36:052
391048899232,4cyclictest0-21swapper/208:06:222
391048899232,4cyclictest0-21swapper/207:41:082
3910488992320,2cyclictest4166588-21cpuspeed_turbos11:26:052
3910488992319,2cyclictest4117015-21fschecks_time10:36:092
391048899230,9cyclictest4108598-21tr10:26:102
391048899230,9cyclictest3928264-21sed07:26:092
391048599239,5cyclictest0-21swapper/110:09:291
3910485992318,3cyclictest0-21swapper/111:06:201
3910485992316,5cyclictest282-21systemd-journal10:54:001
3910482992318,2cyclictest0-21swapper/010:01:170
391048899223,4cyclictest0-21swapper/210:46:082
391048899223,4cyclictest0-21swapper/209:56:102
391048899222,6cyclictest0-21swapper/212:38:342
391048899222,6cyclictest0-21swapper/211:49:222
391048899222,6cyclictest0-21swapper/208:23:152
391048899222,6cyclictest0-21swapper/208:12:362
391048899222,4cyclictest0-21swapper/209:35:002
391048899222,4cyclictest0-21swapper/208:41:122
3910485992218,3cyclictest3956591-21unixbench_singl07:51:231
3910485992218,2cyclictest4186251-21kworker/u8:0-events_unbound12:20:001
3910485992218,2cyclictest0-21swapper/108:59:531
3910485992217,4cyclictest4076630-21kworker/u8:3+flush-8:010:26:141
3910485992217,3cyclictest0-21swapper/110:46:231
3910485992216,4cyclictest4155885-21latency_hist11:15:011
391048899212,6cyclictest0-21swapper/212:32:082
391048899212,4cyclictest0-21swapper/211:00:592
391048899212,4cyclictest0-21swapper/209:42:092
391048899212,4cyclictest0-21swapper/209:42:082
391048899212,4cyclictest0-21swapper/207:46:112
391048899212,4cyclictest0-21swapper/207:30:542
3910488992118,2cyclictest4031993-21cut09:11:032
391048899211,7cyclictest39-21ksoftirqd/209:00:002
3910488992113,6cyclictest4026299-21unixbench_singl09:01:222
391048899210,6cyclictest3965678-21tr08:01:172
391048899210,5cyclictest4157776-21cut11:16:102
391048899210,11cyclictest11469-21python312:01:222
391048599218,4cyclictest0-21swapper/111:40:341
3910485992117,3cyclictest3858451-21kworker/u8:2+flush-8:008:06:101
3910485992117,2cyclictest4117290-21irqcore10:36:111
3910485992116,3cyclictest0-21swapper/109:05:011
3910485992115,4cyclictest0-21swapper/108:51:141
3910485992113,6cyclictest3975872-21ntpq08:11:161
3910485992112,7cyclictest4176459-21diskstats11:36:041
391048899203,4cyclictest0-21swapper/210:51:052
391048899200,6cyclictest3977226-21cpuspeed_turbos08:16:062
391048899200,4cyclictest4012125-21apt-get08:51:022
391048599202,17cyclictest0-21swapper/108:36:191
3910485992016,2cyclictest0-21swapper/109:31:121
3910482992012,7cyclictest4091223-21kworker/0:0+events12:14:460
39100172204,9sleep20-21swapper/207:06:212
391048899192,7cyclictest0-21swapper/212:05:112
39056672183,8sleep30-21swapper/307:05:093
40179942156,5sleep30-21swapper/308:56:303
39261682142,8sleep30-21swapper/307:21:143
41315012133,6sleep30-21swapper/310:51:033
40397362132,7sleep30-21swapper/309:16:113
403162130,8sleep30-21swapper/312:31:123
39773872132,7sleep30-21swapper/308:16:093
39668082132,6sleep30-21swapper/308:05:013
170112132,6sleep30-21swapper/312:10:013
41897362122,6sleep30-21swapper/311:46:133
417722122,6sleep30-21swapper/312:35:003
41721832123,5sleep30-21swapper/311:31:083
41611662122,6sleep30-21swapper/311:21:003
41562192122,6sleep30-21swapper/311:16:033
41509392122,5sleep30-21swapper/311:10:013
41503542122,6sleep30-21swapper/311:06:193
41262852122,6sleep30-21swapper/310:45:013
41216562122,6sleep30-21swapper/310:41:043
41216562122,6sleep30-21swapper/310:41:043
41106962122,6sleep30-21swapper/310:26:193
41013412122,6sleep30-21swapper/310:20:003
40976102122,6sleep30-21swapper/310:16:123
40916242122,6sleep30-21swapper/310:11:103
40906252122,6sleep30-21swapper/310:06:333
40856342122,6sleep30-21swapper/310:01:193
40806472122,6sleep30-21swapper/309:56:213
40762872122,6sleep30-21swapper/309:54:013
40663022122,6sleep30-21swapper/309:43:013
40663022122,6sleep30-21swapper/309:43:013
40568902122,6sleep30-21swapper/309:36:033
40557902122,6sleep30-21swapper/309:31:173
40479082122,6sleep30-21swapper/309:26:083
40417732122,5sleep30-21swapper/309:20:023
40224112122,6sleep30-21swapper/309:01:063
40156522121,7sleep30-21swapper/308:51:123
39974982122,6sleep30-21swapper/308:36:073
39916202122,6sleep30-21swapper/308:30:013
39837092122,6sleep30-21swapper/308:21:103
39582832122,6sleep30-21swapper/307:56:103
39475982122,6sleep30-21swapper/307:46:073
39459992122,6sleep30-21swapper/307:41:133
39214052122,6sleep30-21swapper/307:16:173
326042122,6sleep30-21swapper/312:26:063
326042122,6sleep30-21swapper/312:26:053
309532122,6sleep30-21swapper/312:21:133
232952122,6sleep30-21swapper/312:16:113
79162112,5sleep30-21swapper/312:01:103
69402112,6sleep30-21swapper/311:58:173
41911942112,5sleep30-21swapper/311:50:233
41911942112,5sleep30-21swapper/311:50:223
41762132112,5sleep30-21swapper/311:36:023
41663662112,6sleep30-21swapper/311:26:033
41454202112,6sleep30-21swapper/311:01:233
41364272112,5sleep30-21swapper/310:56:013
41166992113,5sleep30-21swapper/310:36:013
41117062112,5sleep30-21swapper/310:30:413
40706352112,5sleep30-21swapper/309:46:173
40319652112,6sleep30-21swapper/309:11:033
40313162112,5sleep30-21swapper/309:06:293
40105522112,5sleep30-21swapper/308:46:153
40057832112,5sleep30-21swapper/308:41:173
39764092113,5sleep30-21swapper/308:11:383
39711442112,6sleep30-21swapper/308:06:213
39522982112,5sleep30-21swapper/307:51:003
39389772112,5sleep30-21swapper/307:36:123
39321402112,5sleep30-21swapper/307:30:023
39312952112,5sleep30-21swapper/307:26:163
39106682112,6sleep30-21swapper/307:10:393
123142112,5sleep30-21swapper/312:05:243
41810632102,5sleep30-21swapper/311:40:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional