You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 00:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot1s.osadl.org (updated Fri Aug 21, 2026 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3320798215254,82sleep30-21swapper/319:06:063
3315517214659,71sleep20-21swapper/219:05:082
357648221100,2sleep30-21swapper/322:40:013
3315598210353,15sleep10-21swapper/119:05:191
332104929952,15sleep00-21swapper/019:09:210
33225642290,1sleep00-21swapper/019:10:360
3321271992712,7cyclictest14-21ksoftirqd/021:05:010
332127299251,19cyclictest3691119-21taskset00:13:401
332127299251,16cyclictest3624548-21runrttasks23:18:311
332127299250,17cyclictest3533642-21runrttasks22:00:491
332127299250,17cyclictest3417829-21runrttasks20:25:481
332127299250,16cyclictest809-21runrttasks21:39:361
332127299250,16cyclictest3443021-21aten2.4-expect20:50:331
3321271992513,6cyclictest14-21ksoftirqd/020:20:000
332127299245,12cyclictest3487179-21tr21:25:401
332127299245,11cyclictest809-21runrttasks22:45:001
332127299243,10cyclictest809-21runrttasks19:15:221
332127299241,16cyclictest3485426-21runrttasks21:23:181
332127299240,16cyclictest3612317-21runrttasks23:07:171
332127299240,16cyclictest3545889-21runrttasks22:13:471
332127299240,16cyclictest3527617-21runrttasks21:56:001
332127299240,16cyclictest3460859-21taskset21:04:351
332127299240,16cyclictest3436333-21taskset20:43:111
332127299240,16cyclictest3423923-21runrttasks20:32:011
332127299240,16cyclictest3411963-21taskset20:22:271
332127299240,16cyclictest3394476-21aten2.4-expect20:10:261
332127299240,15cyclictest809-21runrttasks23:52:361
332127299240,15cyclictest809-21runrttasks20:55:041
332127299240,15cyclictest809-21runrttasks20:45:461
332127299240,15cyclictest3466223-21awk21:05:421
332127299240,15cyclictest3326920-21sshd19:11:001
3321271992415,4cyclictest0-21swapper/020:40:020
332127299231,16cyclictest3606494-21taskset23:04:321
332127299231,16cyclictest3375238-21taskset19:52:341
332127299230,18cyclictest3673444-21taskset00:00:061
332127299230,18cyclictest3673444-21taskset00:00:061
332127299230,18cyclictest3576393-21taskset22:39:441
332127299230,17cyclictest3660859-21runrttasks23:47:121
332127299230,17cyclictest3643063-21taskset23:35:181
332127299230,16cyclictest3672902-21taskset23:57:331
332127299230,16cyclictest3654589-21taskset23:42:151
332127299230,16cyclictest3642584-21runrttasks23:32:571
332127299230,16cyclictest3636442-21runrttasks23:26:041
332127299230,16cyclictest3600434-21taskset22:58:591
332127299230,16cyclictest3588398-21taskset22:49:171
332127299230,16cyclictest3563998-21runrttasks22:28:261
332127299230,16cyclictest3551947-21taskset22:18:521
332127299230,16cyclictest3539797-21taskset22:08:061
332127299230,16cyclictest3521579-21taskset21:50:471
332127299230,16cyclictest3515656-21taskset21:46:221
332127299230,16cyclictest3509850-21taskset21:44:261
332127299230,16cyclictest3429904-21taskset20:37:061
332127299230,16cyclictest3393696-21taskset20:09:131
332127299230,16cyclictest3387694-21runrttasks20:04:081
332127299230,16cyclictest3381699-21taskset19:59:231
332127299230,16cyclictest3369144-21runrttasks19:46:211
332127299230,16cyclictest3363156-21taskset19:42:041
332127299230,16cyclictest3345072-21runrttasks19:27:331
332127299230,15cyclictest3473111-21runrttasks21:13:361
332127199238,10cyclictest3339133-21sshd19:23:010
3321271992315,4cyclictest246-21systemd-journal23:10:000
332127299221,15cyclictest3351284-21runrttasks19:34:271
332127299220,16cyclictest3703150-21runrttasks00:23:341
332127299220,16cyclictest3697172-21taskset00:19:211
332127299220,16cyclictest3630536-21taskset23:22:511
332127299220,16cyclictest3557923-21taskset22:23:211
332127299220,16cyclictest3474018-21taskset21:15:331
332127299220,16cyclictest3405807-21runrttasks20:16:181
332127299220,15cyclictest3703561-21runrttasks00:25:021
332127299220,15cyclictest3685039-21taskset00:08:271
332127299220,15cyclictest3588873-21taskset22:50:211
332127299220,15cyclictest3570226-21runrttasks22:32:501
332127299220,15cyclictest3357032-21taskset19:36:151
332127299220,14cyclictest809-21runrttasks21:30:261
332127299210,5cyclictest3715583-21taskset00:35:161
332127299210,15cyclictest3715023-21taskset00:31:561
332127299210,15cyclictest3612887-21taskset23:10:131
332127299210,14cyclictest3339022-21taskset19:21:361
332127199216,9cyclictest542-21gdbus19:50:010
332127199208,7cyclictest3539789-21sshd22:08:000
3321274991917,1cyclictest0-21swapper/300:20:003
332127199198,10cyclictest3492510-21sort21:30:360
332127199197,7cyclictest246-21systemd-journal20:13:010
332127199194,10cyclictest3421979-1kthreadcore20:30:400
3321271991914,4cyclictest0-21swapper/021:30:010
3321274991816,1cyclictest0-21swapper/323:45:023
3321274991816,1cyclictest0-21swapper/319:40:013
332127199186,7cyclictest3710214-21sort00:30:350
332127199186,4cyclictest14-21ksoftirqd/023:50:400
332127199185,8cyclictest3629801-21grep23:20:400
332127199185,8cyclictest3437627-21cat20:45:370
332127199185,8cyclictest3433615-21tr20:40:390
3321271991812,5cyclictest3533137-21proc_pri22:00:430
3321274991715,1cyclictest0-21swapper/321:05:003
3321274991715,1cyclictest0-21swapper/320:35:443
3321273991715,1cyclictest0-21swapper/220:40:022
3321273991715,1cyclictest0-21swapper/200:25:002
332127199178,1cyclictest3549800-21kthreadcore22:15:380
332127199178,1cyclictest33443061needreboot19:25:410
332127199176,6cyclictest502-21rs:main0
332127199176,6cyclictest466-21dbus-daemon19:35:400
332127199175,7cyclictest3691064-21seq00:12:580
332127199175,7cyclictest3655575-21aten_repower_vo23:45:320
332127199175,7cyclictest3648528-21seq23:37:000
332127199175,7cyclictest3637655-21df23:30:340
332127199175,7cyclictest3633183-21tr23:25:380
332127199175,7cyclictest3619140-21cut23:15:280
332127199175,7cyclictest3617656-21cat23:10:400
332127199175,7cyclictest3574938-21cut22:35:390
332127199175,7cyclictest3559245-21sed22:25:380
332127199175,7cyclictest3412300-21grep20:25:010
332127199175,7cyclictest3391710-21kthreadcore20:05:400
332127199175,7cyclictest3384646-21cut20:00:390
332127199175,7cyclictest246-21systemd-journal19:16:010
332127199174,8cyclictest542-21gdbus00:30:000
332127199173,6cyclictest3430210-21kworker/0:0+rcu_gp20:55:000
332127199172,4cyclictest14-21ksoftirqd/000:00:380
332127199172,4cyclictest14-21ksoftirqd/000:00:380
332127199172,10cyclictest3578952-1kthreadcore22:40:370
332127199171,3cyclictest3703349-21munin-plugin-st00:25:000
332127199170,11cyclictest3471221-21tr21:10:400
332127199170,10cyclictest3466171-21tail21:05:410
3321274991614,1cyclictest0-21swapper/321:45:393
3321274991614,1cyclictest0-21swapper/320:10:023
332127499161,13cyclictest3642767-21turbostat23:35:003
3321273991614,1cyclictest0-21swapper/200:10:012
332127199165,6cyclictest3605666-21pmu-power23:00:430
332127199165,6cyclictest3594885-21aten_repower_en22:55:200
332127199165,6cyclictest3558287-21date22:25:020
332127199165,6cyclictest3544469-21kthreadcore22:10:410
332127199165,6cyclictest3517654-21kthreadcore21:50:390
332127199165,6cyclictest3510151-21systemd-run21:45:020
332127199165,6cyclictest3481245-21kthreadcore21:20:380
332127199165,6cyclictest3452342-21kthreadcore20:55:390
332127199165,6cyclictest3377411-21cut19:55:380
332127199165,6cyclictest3358394-21smartctl19:40:350
332127199165,6cyclictest3350264-21memory19:30:400
332127199164,7cyclictest466-21dbus-daemon22:55:010
332127199164,7cyclictest3584928-21cut22:45:400
332127199164,7cyclictest3567424-21tr22:30:390
332127199164,7cyclictest3416429-21cut20:25:390
332127199164,4cyclictest0-21swapper/023:55:270
332127199163,8cyclictest3715616-21apt-get00:35:170
332127199161,6cyclictest591rcuop/321:55:160
332127199161,6cyclictest591rcuop/321:35:180
3321271991611,4cyclictest3655317-21/usr/sbin/munin23:45:020
332127199161,10cyclictest3691707-21cut00:15:280
332127199161,10cyclictest3682690-21tr00:05:410
332127199160,9cyclictest3475098-21ps21:15:400
3321274991513,1cyclictest0-21swapper/321:00:003
3321274991513,1cyclictest0-21swapper/300:20:393
3321274991512,1cyclictest0-21swapper/323:25:403
3321274991512,1cyclictest0-21swapper/323:10:003
3321273991513,1cyclictest0-21swapper/223:05:362
3321273991513,1cyclictest0-21swapper/221:10:012
3321273991513,1cyclictest0-21swapper/220:50:402
3321273991513,1cyclictest0-21swapper/220:25:002
3321273991513,1cyclictest0-21swapper/200:13:232
3321273991512,1cyclictest0-21swapper/200:20:002
332127199154,6cyclictest3515120-21cut21:45:430
3321274991412,1cyclictest0-21swapper/322:50:013
3321274991412,1cyclictest0-21swapper/322:30:023
3321274991412,1cyclictest0-21swapper/320:30:393
3321274991412,1cyclictest0-21swapper/320:30:013
332127499141,10cyclictest3545780-21chrt22:12:243
332127499140,7cyclictest3625179-21chrt23:20:283
3321273991412,1cyclictest0-21swapper/223:20:002
3321273991412,1cyclictest0-21swapper/222:10:012
3321273991412,1cyclictest0-21swapper/221:50:012
3321273991412,1cyclictest0-21swapper/221:05:012
3321273991412,1cyclictest0-21swapper/219:50:002
332127499131,9cyclictest3684868-21chrt00:06:163
332127499131,9cyclictest3521779-21chrt21:53:203
332127499131,9cyclictest3369265-21chrt19:47:543
332127499131,9cyclictest3334159-21chrt19:20:333
332127499131,9cyclictest3333094-21chrt19:18:013
3321274991312,1cyclictest0-21swapper/321:35:453
3321274991311,1cyclictest0-21swapper/323:50:023
3321274991311,1cyclictest0-21swapper/323:00:413
3321274991311,1cyclictest0-21swapper/322:55:383
3321274991311,1cyclictest0-21swapper/322:20:393
3321274991311,1cyclictest0-21swapper/321:20:013
3321274991311,1cyclictest0-21swapper/321:15:023
3321274991311,1cyclictest0-21swapper/320:55:013
3321274991311,1cyclictest0-21swapper/320:45:403
3321274991311,1cyclictest0-21swapper/319:55:023
3321274991311,1cyclictest0-21swapper/300:10:383
3321274991310,1cyclictest0-21swapper/323:55:343
3321274991310,1cyclictest0-21swapper/322:50:383
3321274991310,1cyclictest0-21swapper/321:40:343
332127499130,11cyclictest3721344-21turbostat00:40:003
3321273991311,1cyclictest0-21swapper/221:35:012
3321273991311,1cyclictest0-21swapper/219:55:002
3321273991311,1cyclictest0-21swapper/219:35:012
3321273991311,1cyclictest0-21swapper/200:05:002
3321273991311,1cyclictest0-21swapper/200:05:002
332127499129,1cyclictest0-21swapper/321:30:383
332127499129,1cyclictest0-21swapper/319:25:413
332127499126,4cyclictest0-21swapper/322:40:163
332127499123,8cyclictest46450irq/121-eno120:10:373
332127499121,9cyclictest3467265-21chrt21:10:013
332127499121,9cyclictest3436302-21chrt20:42:483
332127499121,9cyclictest3406613-21chrt20:20:283
332127499121,9cyclictest3405781-21chrt20:15:593
332127499121,9cyclictest3351120-21chrt19:32:193
332127499121,8cyclictest3643042-21chrt23:35:023
332127499121,8cyclictest3564684-21chrt22:30:073
332127499121,8cyclictest3485873-21chrt21:25:153
3321274991210,1cyclictest0-21swapper/323:15:413
3321274991210,1cyclictest0-21swapper/322:05:403
3321274991210,1cyclictest0-21swapper/320:00:373
3321274991210,1cyclictest0-21swapper/300:30:403
332127499120,10cyclictest46450irq/121-eno123:10:373
332127499120,10cyclictest46450irq/121-eno121:20:363
3321273991210,1cyclictest0-21swapper/223:15:002
3321273991210,1cyclictest0-21swapper/223:02:222
3321273991210,1cyclictest0-21swapper/223:00:012
3321273991210,1cyclictest0-21swapper/220:30:392
3321273991210,1cyclictest0-21swapper/220:20:012
3321273991210,1cyclictest0-21swapper/220:00:402
3321273991210,1cyclictest0-21swapper/200:00:012
332127399120,9cyclictest3654664-21chrt23:43:112
332127399120,9cyclictest3327085-21chrt19:13:072
332127499119,1cyclictest0-21swapper/322:00:393
332127499119,1cyclictest0-21swapper/300:04:333
332127499119,1cyclictest0-21swapper/300:04:333
332127499111,8cyclictest3705355-21chrt00:25:393
332127499111,8cyclictest3522541-21chrt21:55:333
332127499111,8cyclictest3379229-21chrt19:55:393
332127499111,8cyclictest3357839-21chrt19:40:293
332127499111,8cyclictest3321567-21chrt19:10:193
332127499110,9cyclictest46450irq/121-eno123:50:433
332127499110,8cyclictest3546368-21taskset22:15:163
332127399119,1cyclictest0-21swapper/223:49:142
332127399119,1cyclictest0-21swapper/223:35:382
332127399119,1cyclictest0-21swapper/223:25:382
332127399119,1cyclictest0-21swapper/223:24:372
332127399119,1cyclictest0-21swapper/222:52:522
332127399119,1cyclictest0-21swapper/222:30:392
332127399119,1cyclictest0-21swapper/222:20:062
332127399119,1cyclictest0-21swapper/221:50:402
332127399119,1cyclictest0-21swapper/221:45:022
332127399119,1cyclictest0-21swapper/220:12:292
332127399119,1cyclictest0-21swapper/200:35:162
332127399119,1cyclictest0-21swapper/200:35:012
332127399119,1cyclictest0-21swapper/200:28:062
332127399115,4cyclictest3413253-21taskset20:25:362
332127399110,9cyclictest3479334-21chrt21:17:572
332127399110,8cyclictest3637047-21chrt23:30:052
332127399110,8cyclictest3576785-21taskset22:40:162
332127399110,8cyclictest3570699-21chrt22:35:072
332127399110,8cyclictest3546481-21chrt22:15:272
332127399110,8cyclictest3528256-21chrt22:00:092
332127399110,8cyclictest3485866-21chrt21:25:102
332127399110,8cyclictest3479827-21chrt21:20:132
332127399110,8cyclictest3448992-21taskset20:55:252
332127399110,8cyclictest3436165-21chrt20:41:022
332127399110,8cyclictest3393430-21chrt20:05:482
332127399110,8cyclictest3338970-21chrt19:20:562
332127399108,1cyclictest0-21swapper/222:26:152
332127399108,1cyclictest0-21swapper/220:46:552
332127399108,1cyclictest0-21swapper/219:40:212
332127399108,1cyclictest0-21swapper/219:26:012
332127399107,1cyclictest0-21swapper/219:35:142
332127399101,7cyclictest3586847-21chrt22:45:412
332127399100,8cyclictest3666814-21chrt23:51:042
332127399100,8cyclictest3541350-21chrt22:10:382
332127399100,8cyclictest3523047-21chrt21:55:362
332127399100,8cyclictest34982642sleep221:35:252
332127399100,8cyclictest3472944-21chrt21:11:282
332127399100,8cyclictest3376589-21chrt19:55:342
332127399100,8cyclictest3328037-21chrt19:15:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional