You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 08:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Sun Jun 14, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3675425995424,4cyclictest0-21swapper/122:50:181
3675425995037,10cyclictest231ktimers/123:25:131
3675430994937,9cyclictest311ktimers/222:40:132
3675420994840,4cyclictest3689802-21cron19:50:000
3675420994635,8cyclictest3763146-21grep23:20:260
3675425994532,9cyclictest231ktimers/122:35:111
3675420994536,6cyclictest3765300-21sh23:30:000
3675425994335,4cyclictest3707070-21auditctl20:40:001
3675425994333,7cyclictest3745224-21fschecks_count22:30:151
3675430994235,5cyclictest3710264-21kworker/u8:1+events_unbound20:53:082
367542099421,38cyclictest121ktimers/021:35:110
3675425994127,10cyclictest231ktimers/100:05:131
3675425993927,8cyclictest3789620-21sendmail00:40:001
3675420993931,6cyclictest121ktimers/023:45:130
3675420993927,8cyclictest3684868-21grep19:35:170
3675433993831,4cyclictest3780857-21cron00:15:003
3675433993830,4cyclictest0-21swapper/323:00:003
3675433993829,5cyclictest3761883-21cron23:20:003
3675433993827,7cyclictest3771908-21grep23:45:263
3675430993718,5cyclictest131rcu_preempt21:10:212
3675425993727,5cyclictest0-21swapper/119:27:491
3675425993625,7cyclictest3729051-21grep21:40:241
3675420993628,4cyclictest0-21swapper/020:45:240
3675420993628,4cyclictest0-21swapper/020:45:240
3675433993527,5cyclictest36813052sleep319:25:113
3675430993520,5cyclictest131rcu_preempt22:45:142
3675430993519,9cyclictest131rcu_preempt20:12:312
3675430993519,5cyclictest131rcu_preempt22:58:392
3675430993519,4cyclictest131rcu_preempt19:59:542
3675430993518,4cyclictest131rcu_preempt22:07:252
3675430993517,3cyclictest0-21swapper/223:07:042
3675430993514,3cyclictest131rcu_preempt21:35:212
3675425993525,6cyclictest0-21swapper/100:10:341
3675420993529,3cyclictest13550irq/42-30be0000.ethernet20:39:590
3675433993422,7cyclictest0-21swapper/320:05:273
367543099344,8cyclictest32-21ksoftirqd/222:30:262
3675430993426,6cyclictest3754966-21kworker/u8:2+events_unbound23:10:402
3675430993425,5cyclictest3735898-21unixbench_singl22:00:272
3675430993425,5cyclictest3735898-21unixbench_singl22:00:262
3675430993420,5cyclictest131rcu_preempt22:15:072
3675430993415,4cyclictest3789041-21timerandwakeup00:35:282
3675430993410,7cyclictest32-21ksoftirqd/200:00:272
3675420993423,7cyclictest3677173-21grep19:15:010
3675420993419,10cyclictest121ktimers/023:50:120
3675430993326,4cyclictest0-21swapper/220:15:162
3675430993325,4cyclictest3679381-21sendmail19:20:012
3675430993325,4cyclictest0-21swapper/220:20:272
3675430993325,4cyclictest0-21swapper/200:20:162
3675430993319,4cyclictest131rcu_preempt23:01:372
3675430993316,9cyclictest131rcu_preempt21:05:142
3675430993315,11cyclictest131rcu_preempt19:30:172
3675430993311,5cyclictest301rcuc/219:52:452
3675430993310,4cyclictest301rcuc/223:36:462
3675425993326,4cyclictest3760171-21cron23:15:001
3675425993325,4cyclictest0-21swapper/123:03:371
3675420993325,5cyclictest3761891-21idleruntime-cro23:20:000
3675420993324,6cyclictest3708784-21sh20:45:000
3675433993225,3cyclictest0-21swapper/322:45:273
3675433993224,4cyclictest0-21swapper/322:50:273
3675430993225,3cyclictest0-21swapper/222:25:252
3675430993224,4cyclictest0-21swapper/223:55:162
3675430993224,4cyclictest0-21swapper/219:10:162
3675430993223,5cyclictest311ktimers/200:30:192
3675430993221,8cyclictest311ktimers/221:01:062
3675430993219,5cyclictest3742761-21kworker/u8:2+events_unbound22:23:212
3675430993218,7cyclictest3705042-21kworker/u8:0+events_unbound20:46:242
3675430993218,7cyclictest3705042-21kworker/u8:0+events_unbound20:46:242
3675430993218,3cyclictest131rcu_preempt22:50:352
3675430993216,5cyclictest131rcu_preempt21:15:212
3675430993216,11cyclictest131rcu_preempt23:45:142
3675430993215,4cyclictest131rcu_preempt20:58:482
3675430993214,10cyclictest131rcu_preempt19:35:222
3675430993213,3cyclictest131rcu_preempt20:40:182
3675430993210,6cyclictest32-21ksoftirqd/220:35:012
3675425993221,7cyclictest3684028-21grep19:30:251
3675433993124,4cyclictest0-21swapper/300:05:283
3675433993123,4cyclictest0-21swapper/323:00:263
3675433993121,6cyclictest0-21swapper/320:00:253
3675433993121,6cyclictest0-21swapper/300:34:593
3675430993121,4cyclictest131rcu_preempt21:20:162
3675430993117,6cyclictest3680981-21kworker/u8:2+events_unbound19:28:442
3675430993117,4cyclictest131rcu_preempt21:40:192
3675430993117,4cyclictest131rcu_preempt19:20:412
3675430993114,9cyclictest131rcu_preempt21:45:172
3675430993114,5cyclictest131rcu_preempt23:20:142
3675430993114,3cyclictest131rcu_preempt19:45:212
3675430993111,13cyclictest32-21ksoftirqd/220:25:232
3675430993111,12cyclictest131rcu_preempt00:05:272
3675425993123,4cyclictest0-21swapper/123:55:001
3675425993120,7cyclictest0-21swapper/122:00:001
3675425993119,8cyclictest3724335-21apt-key21:30:011
3675425993118,10cyclictest3693228-21tr20:00:011
367542099311,2cyclictest0-21swapper/000:10:160
3675433993021,5cyclictest0-21swapper/323:40:003
3675433993020,6cyclictest0-21swapper/321:30:003
3675430993021,4cyclictest0-21swapper/221:50:172
3675430993019,4cyclictest131rcu_preempt00:25:192
3675430993018,4cyclictest131rcu_preempt22:10:242
3675430993018,3cyclictest131rcu_preempt19:40:202
3675430993016,4cyclictest131rcu_preempt23:15:162
3675430993014,9cyclictest131rcu_preempt21:30:152
3675430993014,9cyclictest131rcu_preempt20:35:202
3675430993014,9cyclictest131rcu_preempt00:10:342
3675430993014,6cyclictest3766201-21processes23:30:222
3675430993014,5cyclictest131rcu_preempt22:35:202
3675430993011,4cyclictest131rcu_preempt21:55:282
3675425993022,4cyclictest0-21swapper/121:05:171
3675420993023,4cyclictest0-21swapper/022:05:250
3675420993019,7cyclictest0-21swapper/020:50:260
3675420993018,9cyclictest121ktimers/020:05:140
3675433992921,5cyclictest0-21swapper/322:05:253
3675433992919,7cyclictest3691521-21munin-run19:55:013
3675433992917,8cyclictest1-21systemd23:08:373
3675433992916,8cyclictest3677251-21latency_hist19:15:023
367543099294,16cyclictest32-21ksoftirqd/220:05:192
3675430992922,4cyclictest311ktimers/200:18:212
3675430992917,4cyclictest131rcu_preempt23:27:402
3675430992914,9cyclictest131rcu_preempt21:25:202
3675430992914,4cyclictest131rcu_preempt20:00:132
3675430992912,9cyclictest131rcu_preempt23:55:012
3675425992922,5cyclictest208-21systemd-logind20:26:401
3675425992921,4cyclictest0-21swapper/121:55:001
3675425992920,5cyclictest3701972-21sh20:25:011
3675420992922,3cyclictest0-21swapper/022:40:000
3675420992921,4cyclictest3705378-21munin-plugin-st20:35:010
3675420992920,5cyclictest0-21swapper/023:05:230
3675433992821,4cyclictest0-21swapper/322:40:263
3675433992821,3cyclictest0-21swapper/300:00:013
3675433992820,4cyclictest0-21swapper/321:20:013
3675433992820,4cyclictest0-21swapper/320:35:253
3675433992819,6cyclictest0-21swapper/320:45:243
3675433992819,6cyclictest0-21swapper/320:45:243
367543099288,10cyclictest32-21ksoftirqd/223:40:152
3675425992822,4cyclictest3717544-21kworker/u8:3+events_unbound21:38:211
3675425992821,4cyclictest0-21swapper/119:35:281
3675425992820,4cyclictest0-21swapper/120:00:241
3675425992820,4cyclictest0-21swapper/100:15:161
3675425992818,5cyclictest3677258-21munin-node19:15:021
3675425992817,8cyclictest3767034-21cat23:35:001
3675425992817,8cyclictest1-21systemd22:28:311
367542099282,4cyclictest131rcu_preempt23:55:130
367542099282,21cyclictest3789605-21munin-run00:40:000
3675420992821,5cyclictest3729197-21kworker/u8:1+events_unbound21:53:240
3675420992818,6cyclictest3715192-21unixbench_singl21:00:260
3675420992817,7cyclictest3768514-21grep23:35:270
3675420992815,5cyclictest3748035-21kworker/u8:3+events_unbound22:47:310
3675433992721,3cyclictest0-21swapper/321:55:193
3675433992719,4cyclictest0-21swapper/300:15:263
3675420992721,4cyclictest3730989-21kworker/u8:0+events_unbound22:19:430
3675420992720,5cyclictest3751499-21kworker/u8:1+events_unbound22:58:370
3675420992720,4cyclictest13550irq/42-30be0000.ethernet19:50:180
3675420992720,3cyclictest0-21swapper/022:20:160
3675420992717,7cyclictest3682319-21grep19:25:240
3675420992717,6cyclictest3694462-21grep20:00:250
3675420992717,6cyclictest0-21swapper/000:15:260
3675420992715,7cyclictest204-21dbus-daemon20:58:070
3675433992618,6cyclictest3763194-21unixbench_singl23:20:263
3675433992617,7cyclictest391ktimers/322:15:133
3675433992617,5cyclictest0-21swapper/323:25:253
3675433992614,9cyclictest3700275-21tr20:20:013
367542599268,4cyclictest3712495-21cat20:55:141
3675425992619,3cyclictest0-21swapper/122:58:351
3675425992618,4cyclictest0-21swapper/122:20:011
3675425992618,4cyclictest0-21swapper/100:00:001
3675425992617,6cyclictest0-21swapper/123:20:001
3675425992615,8cyclictest3785990-21idleruntime-cro00:30:001
3675425992615,7cyclictest0-21swapper/122:00:261
3675425992615,7cyclictest0-21swapper/122:00:251
3675420992622,2cyclictest13550irq/42-30be0000.ethernet19:40:130
3675420992619,5cyclictest3749777-21kworker/u8:0+events_unbound22:43:110
3675420992619,5cyclictest3722116-21kworker/u8:1+events_unbound21:21:390
3675420992618,6cyclictest3717544-21kworker/u8:3+events_unbound21:28:170
3675420992617,6cyclictest3783857-21grep00:20:260
3675420992615,7cyclictest3734110-21grep21:55:280
3675433992519,4cyclictest391ktimers/319:35:133
3675433992517,4cyclictest0-21swapper/321:50:253
3675425992518,4cyclictest0-21swapper/123:40:151
3675425992518,4cyclictest0-21swapper/121:25:011
3675425992517,5cyclictest3720754-21sendmail-msp21:20:001
3675420992521,2cyclictest13550irq/42-30be0000.ethernet19:20:120
3675420992518,4cyclictest3700258-21sendmail20:20:010
3675420992518,4cyclictest0-21swapper/023:10:230
3675420992516,6cyclictest3736293-21cron22:05:010
3675420992516,6cyclictest3736293-21cron22:05:010
3675420992516,6cyclictest3684047-21grep19:30:260
367542099251,5cyclictest131rcu_preempt00:25:120
367542099251,20cyclictest0-21swapper/022:26:470
3675433992418,4cyclictest3782553-21kworker/u8:2+events_unbound00:28:513
3675433992417,4cyclictest3777016-21grep00:00:263
3675433992417,4cyclictest3692741-21tail19:55:253
3675433992417,4cyclictest3687193-21ntpq19:40:213
3675433992417,3cyclictest0-21swapper/321:10:273
3675433992416,4cyclictest0-21swapper/319:30:263
3675433992414,7cyclictest3708781-21cron20:44:593
3675425992418,4cyclictest164-21systemd-journal22:12:401
3675425992418,3cyclictest0-21swapper/119:40:201
3675425992417,4cyclictest0-21swapper/100:25:001
3675425992414,7cyclictest3717975-21sed21:10:211
3675425992414,6cyclictest0-21swapper/122:45:261
3675425992414,6cyclictest0-21swapper/119:15:241
3675420992419,2cyclictest13550irq/42-30be0000.ethernet21:30:110
3675420992417,5cyclictest3766687-21kworker/u8:1+events_unbound23:42:410
3675420992417,4cyclictest3746105-21grep22:30:260
367542099241,19cyclictest0-21swapper/022:13:270
367542099241,19cyclictest0-21swapper/019:58:540
367542099241,19cyclictest0-21swapper/019:16:500
367542099241,18cyclictest0-21swapper/021:45:570
3675433992317,3cyclictest0-21swapper/322:35:243
3675433992316,4cyclictest0-21swapper/323:50:233
3675433992316,4cyclictest0-21swapper/319:20:253
3675433992316,3cyclictest0-21swapper/322:30:263
3675433992316,3cyclictest0-21swapper/321:40:233
3675433992315,5cyclictest0-21swapper/319:20:003
3675433992315,4cyclictest0-21swapper/323:30:253
3675433992315,4cyclictest0-21swapper/323:10:233
3675433992315,4cyclictest0-21swapper/320:25:263
3675433992312,7cyclictest0-21swapper/322:25:253
3675425992317,3cyclictest0-21swapper/120:45:201
3675425992317,3cyclictest0-21swapper/120:45:201
3675425992316,5cyclictest208-21systemd-logind23:05:401
3675425992316,5cyclictest208-21systemd-logind20:14:401
3675425992316,3cyclictest0-21swapper/120:53:081
3675425992312,6cyclictest0-21swapper/122:20:261
367542099235,15cyclictest3717325-21idleruntime-cro21:10:000
3675420992317,4cyclictest3694677-21kworker/u8:0+events_unbound20:13:000
3675420992316,4cyclictest0-21swapper/023:00:260
3675420992314,5cyclictest0-21swapper/021:10:270
367542099231,19cyclictest3719258-21taskset21:15:150
367542099231,18cyclictest0-21swapper/000:02:390
367542099230,19cyclictest0-21swapper/021:42:500
367542099230,19cyclictest0-21swapper/000:33:070
367543399227,5cyclictest0-21swapper/321:45:163
3675433992216,3cyclictest0-21swapper/321:05:213
3675433992216,3cyclictest0-21swapper/320:55:253
3675433992216,3cyclictest0-21swapper/320:20:283
3675433992215,4cyclictest0-21swapper/300:35:163
3675433992214,4cyclictest0-21swapper/320:30:253
3675433992212,6cyclictest0-21swapper/321:30:253
3675425992216,3cyclictest0-21swapper/121:00:151
3675425992214,5cyclictest0-21swapper/122:40:171
367542599220,18cyclictest0-21swapper/120:05:141
367542099221,19cyclictest0-21swapper/020:24:180
367542099221,18cyclictest3752249-21cut22:50:200
367542099220,18cyclictest0-21swapper/000:05:360
3675433992116,3cyclictest391ktimers/322:00:123
3675433992116,3cyclictest391ktimers/322:00:123
3675433992115,4cyclictest3717544-21kworker/u8:3+events_unbound21:20:113
3675433992115,3cyclictest0-21swapper/300:20:263
3675433992114,5cyclictest391ktimers/320:55:003
3675433992113,6cyclictest391ktimers/320:10:113
3675433992113,5cyclictest391ktimers/322:10:093
3675425992116,3cyclictest3787689-21apt-get00:35:001
3675425992115,3cyclictest0-21swapper/123:45:141
3675425992115,3cyclictest0-21swapper/120:30:231
3675425992115,3cyclictest0-21swapper/119:45:221
3675425992113,5cyclictest231ktimers/120:18:071
3675425992111,6cyclictest0-21swapper/121:45:261
3675420992116,3cyclictest0-21swapper/023:33:010
367542099211,3cyclictest0-21swapper/020:27:120
3675433992013,4cyclictest3715755-21latency_hist21:05:013
3675433992013,4cyclictest3689623-21sshd19:47:513
367542599209,8cyclictest3736644-21df_inode22:05:141
3675425992014,3cyclictest0-21swapper/123:20:241
3675425992014,3cyclictest0-21swapper/119:50:181
3675425992013,5cyclictest231ktimers/119:20:131
3675425992012,5cyclictest3768919-21latency_hist23:40:011
3675433991913,3cyclictest3742382-21sendmail_mailtr22:20:243
3675433991912,5cyclictest391ktimers/323:40:123
3675425991912,5cyclictest231ktimers/100:00:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional