You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 22:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu Nov 20, 2025 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
41810452930,2chrt586-21kworker/3:2+events09:36:293
4030169996045,10cyclictest166493-21latency_hist12:40:011
4030164995950,6cyclictest4186326-21latency_hist09:45:010
40781002580,4chrt201rcuc/007:56:180
4030171995837,18cyclictest282-21systemd-journal10:50:002
4030164995748,6cyclictest4106966-21latency_hist08:25:010
4030169995648,5cyclictest96022-21ntpq11:26:301
4030164995645,8cyclictest110805-21ntpq11:41:240
1253872560,5sleep1281rcuc/111:56:211
4030164995545,7cyclictest166600-21base6412:40:010
4030171995444,7cyclictest282-21systemd-journal11:40:012
4030164995430,21cyclictest7176-21latency_hist10:00:010
4030169995343,8cyclictest131130-21ntpq12:01:271
4030169995342,8cyclictest115826-21ntpq11:46:311
4030164995328,21cyclictest156620-21latency_hist12:30:010
4030169995244,5cyclictest4030031-21kworker/u8:1+flush-8:008:21:191
4030169995244,5cyclictest101773-21latency_hist11:35:011
4030169995243,5cyclictest4030031-21kworker/u8:1+events_unbound07:56:111
4030169995141,8cyclictest6308-21ntpq09:56:251
4030164995144,5cyclictest37560-21kworker/u8:3+flush-8:010:56:300
4030171995034,13cyclictest282-21systemd-journal10:30:002
4030169995040,8cyclictest51339-21ntpq10:41:261
4030169995040,8cyclictest51339-21ntpq10:41:261
4030164994942,5cyclictest77125-21apt-key11:10:010
4030169994842,4cyclictest4130816-21ntpq08:46:241
4030169994738,6cyclictest91181-21ntpq11:21:311
1422512470,1chrt142250-21cpuspeed12:16:151
4030169994537,5cyclictest4156679-21latency_hist09:15:011
4030164994434,7cyclictest4101755-21apt-get08:20:010
4030169994336,4cyclictest4161622-21latency_hist09:20:011
4030169994331,9cyclictest76026-21ntpq11:06:251
4030164994333,8cyclictest160653-21ntpq12:31:240
4030164994325,15cyclictest4146807-21latency_hist09:05:010
4030171994236,4cyclictest4030031-21kworker/u8:1+flush-8:008:56:352
4030169994234,5cyclictest4046865-21kworker/u8:0+events_unbound07:41:311
4030169994232,8cyclictest4180527-21ntpq09:36:221
4030164994231,8cyclictest4131664-21latency_hist08:50:000
403016499421,39cyclictest1-21systemd11:40:010
4030169994136,3cyclictest4030031-21kworker/u8:1+events_unbound08:06:201
4030169994134,5cyclictest4137213-21apt-get08:56:131
4030169994133,6cyclictest107087-21apt-get11:41:111
4030169994035,3cyclictest4030031-21kworker/u8:1+flush-8:008:01:321
4030169994033,5cyclictest82371-21apt-get11:16:111
4030169994030,8cyclictest4041102-21ntpq07:16:281
4030169994030,8cyclictest132217-21apt-get12:06:111
4030171993931,6cyclictest77726-21cut11:11:142
4030164993935,3cyclictest4030031-21kworker/u8:1+flush-8:010:05:000
4030164993932,5cyclictest4030031-21kworker/u8:1+flush-8:009:15:310
4030164993924,13cyclictest112556-21irqcore11:46:220
4030171993824,12cyclictest4132262-21aten2_r5power_c08:51:142
4030169993830,6cyclictest4035076-21ls07:14:591
4030169993829,7cyclictest4030031-21kworker/u8:1+flush-8:009:26:261
4030169993829,7cyclictest4030031-21kworker/u8:1+flush-8:009:26:261
4030164993820,16cyclictest86611-21unixbench_singl11:16:320
4030164993815,20cyclictest4150904-21ntpq09:06:230
4030171993710,23cyclictest4078103-21kernelversion07:56:182
403016499379,9cyclictest587-21runrttasks11:01:150
4030164993732,3cyclictest126693-21apt-get12:00:000
4030164993721,14cyclictest16376-21sshd10:06:280
4030164993720,15cyclictest829-21mta-sts-daemon11:21:240
40255832373,24sleep14025440-21/usr/sbin/munin07:06:151
4030171993627,7cyclictest282-21systemd-journal11:46:302
4030171993611,20cyclictest161871-21apt-get12:36:142
4030169993631,3cyclictest4147862-21irqrtprio09:06:161
4030169993629,4cyclictest4030031-21kworker/u8:1+flush-8:010:20:011
4030164993627,7cyclictest135946-21ntpq12:06:240
4030164993626,7cyclictest4066989-21latency_hist07:45:000
403016499361,9cyclictest1422502cpuspeed12:16:150
403016499360,21cyclictest26900-21sshd10:19:300
402986923625,8sleep20-21swapper/207:08:292
4030171993525,7cyclictest27544-21apt-get10:21:112
4030169993528,5cyclictest4030031-21kworker/u8:1+flush-8:010:01:291
4030169993526,6cyclictest26958-21latency_hist10:20:001
4030164993526,7cyclictest4091133-21ntpq08:06:250
4030164993520,13cyclictest97891-21ps11:31:220
4030164993520,13cyclictest31819-21unixbench_singl10:21:310
4030164993520,13cyclictest0-21swapper/010:45:000
4030164993520,13cyclictest0-21swapper/010:44:590
4030164993517,16cyclictest46902-21unixbench_singl10:36:320
403017199348,4cyclictest0-21swapper/208:06:202
4030171993427,5cyclictest4156668-21cron09:15:002
4030169993428,4cyclictest282-21systemd-journal11:01:301
4030169993426,5cyclictest282-21systemd-journal07:28:291
4030169993422,9cyclictest282-21systemd-journal10:26:521
403016499343,17cyclictest4033436-21cut07:11:220
4030164993416,16cyclictest0-21swapper/012:01:300
4030164993416,16cyclictest0-21swapper/011:06:200
4030164993416,15cyclictest0-21swapper/008:30:000
4030164993412,19cyclictest0-21swapper/010:26:120
403017199332,12cyclictest4062392-21apt-get07:41:142
4030171993319,12cyclictest0-21swapper/207:20:002
4030171993315,16cyclictest282-21systemd-journal12:09:302
4030169993328,3cyclictest149235-21kthreadcore12:21:201
4030169993322,8cyclictest4175553-21ntpq09:31:251
4030169993322,7cyclictest282-21systemd-journal08:13:291
403016499335,6cyclictest0-21swapper/007:36:120
403016499333,14cyclictest4055031-21tr07:31:210
403016499332,29cyclictest0-21swapper/007:51:300
4030164993317,14cyclictest829-21mta-sts-daemon07:46:280
4030164993316,15cyclictest0-21swapper/010:46:300
4030164993316,15cyclictest0-21swapper/008:15:010
4030164993315,16cyclictest0-21swapper/009:36:120
4030164993315,16cyclictest0-21swapper/008:41:110
4030164993314,17cyclictest832-21mta-sts-daemon10:31:370
403017199327,4cyclictest0-21swapper/210:51:132
4030171993227,3cyclictest41887-21unixbench_multi10:31:322
4030169993228,2cyclictest0-21swapper/112:15:001
4030169993227,3cyclictest103083-21kthreadcore11:36:571
4030169993223,6cyclictest282-21systemd-journal10:46:301
4030169993221,8cyclictest4056171-21ntpq07:31:241
403016499322,12cyclictest4161973-21apt-get09:21:110
4030164993217,13cyclictest0-21swapper/012:21:200
4030164993214,16cyclictest0-21swapper/007:26:190
4030164993214,16cyclictest0-21swapper/007:20:010
4030164993212,2cyclictest0-21swapper/011:26:260
403017199313,7cyclictest4117179-21apt-get08:36:162
4030171993115,14cyclictest0-21swapper/208:11:142
4030171993113,2cyclictest0-21swapper/212:15:002
4030169993124,5cyclictest4112487-21diskstats08:31:141
403016499319,6cyclictest4172131-21grep09:31:150
403016499318,7cyclictest4167746-21sed09:26:190
403016499318,7cyclictest4167746-21sed09:26:190
403016499315,5cyclictest0-21swapper/008:31:100
403016499312,10cyclictest1431-21ntpq09:51:420
403016499311,9cyclictest120936-21ntpq11:51:280
403016499311,11cyclictest587-21runrttasks08:36:160
403017199305,10cyclictest4146200-21grep09:01:292
4030171993014,14cyclictest0-21swapper/212:01:232
403017199301,11cyclictest87308-21apt-get11:21:142
403017199301,11cyclictest156958-21apt-get12:31:132
4030169993023,6cyclictest4030031-21kworker/u8:1+flush-8:010:11:281
4030169993023,5cyclictest4046865-21kworker/u8:0+flush-8:007:36:161
4030164993026,2cyclictest22016-21systemd-run10:15:000
4030164993011,7cyclictest140946-21ntpq12:11:260
4030164993011,1cyclictest0-21swapper/007:21:180
4030164993010,5cyclictest4140994-21ntpq08:56:460
403017199298,7cyclictest4107132-21sed08:25:012
403017199293,5cyclictest67317-21apt-get11:01:152
403017199292,6cyclictest4082146-21apt-get08:01:122
403017199292,2cyclictest1253892grep11:56:212
4030171992916,11cyclictest142315-21tr12:16:152
403017199291,11cyclictest117165-21apt-get11:51:152
4030169992921,6cyclictest4102239-21kworker/u8:2+flush-8:010:36:251
4030169992920,7cyclictest62360-21apt-get10:56:111
4030164992923,4cyclictest61688-21grep10:51:330
4030164992912,5cyclictest4135959-21ntpq08:51:250
4030164992912,5cyclictest4082334-21ls08:01:140
4030164992911,2cyclictest0-21swapper/009:11:130
403017199284,8cyclictest282-21systemd-journal09:25:002
403017199282,8cyclictest4041941-21apt-get07:20:032
403017199282,7cyclictest17397-21apt-get10:11:152
4030171992825,2cyclictest4176090-21unixbench_singl09:31:322
4030171992816,11cyclictest0-21swapper/208:50:012
4030171992814,12cyclictest0-21swapper/210:20:002
4030171992811,3cyclictest0-21swapper/209:16:222
403017199280,14cyclictest4054602-21tr07:31:202
4030169992822,4cyclictest4030031-21kworker/u8:1+events_unbound09:51:341
4030169992821,5cyclictest4030031-21kworker/u8:1+flush-8:007:46:181
4030169992821,5cyclictest37560-21kworker/u8:3+events_unbound12:26:231
4030169992819,6cyclictest4120900-21ntpq08:36:281
4030169992819,6cyclictest27441-21kworker/u8:0+flush-8:010:31:271
4030164992812,2cyclictest0-21swapper/009:46:310
403017199277,7cyclictest4187612-21tr09:46:242
403017199276,7cyclictest4147355-21sort09:06:122
403017199272,6cyclictest4072281-21apt-get07:51:132
4030171992714,11cyclictest0-21swapper/209:56:312
4030171992713,13cyclictest17061-21munin-plugin-st10:10:002
4030171992711,5cyclictest95260-21tr11:26:262
403017199271,11cyclictest4170724-21ntpq09:26:282
403017199271,11cyclictest4170724-21ntpq09:26:282
4030171992710,3cyclictest0-21swapper/210:41:212
4030171992710,3cyclictest0-21swapper/210:41:212
4030169992722,3cyclictest62047-21systemd-run10:55:011
4030169992721,4cyclictest4171500-21kworker/u8:3+flush-8:009:41:251
4030169992721,4cyclictest16737-21unixbench_singl10:06:321
403017199264,6cyclictest82371-21apt-get11:16:122
4030171992621,4cyclictest4181385-21sendmail09:40:012
4030171992610,3cyclictest0-21swapper/211:06:212
4030171992610,3cyclictest0-21swapper/208:41:192
4030169992621,2cyclictest4047124-21sh07:25:001
4030169992620,3cyclictest0-21swapper/111:11:081
4030169992617,6cyclictest4111905-21latency_hist08:30:011
4030169992615,8cyclictest4145990-21ntpq09:01:251
403017199258,3cyclictest0-21swapper/210:36:302
403017199257,5cyclictest64427-21tr10:56:222
403017199255,7cyclictest8366-21sed10:01:192
403017199251,7cyclictest151997-21apt-get12:26:112
4030171992513,2cyclictest0-21swapper/207:29:132
4030171992512,2cyclictest0-21swapper/209:54:232
4030169992520,3cyclictest4171500-21kworker/u8:3+events_unbound09:46:311
4030169992520,2cyclictest0-21swapper/108:16:311
4030169992515,7cyclictest4076855-21latency_hist07:55:011
1556132253,6sleep30-21swapper/312:26:213
403017199245,7cyclictest4111004-21grep08:26:402
403017199242,6cyclictest4057392-21apt-get07:36:122
4030171992421,2cyclictest4112456-21cpuspeed_turbos08:31:132
4030171992414,9cyclictest0-21swapper/207:46:212
4030171992410,2cyclictest0-21swapper/212:21:192
4030169992420,2cyclictest4046865-21kworker/u8:0+events_unbound08:41:131
4030169992418,3cyclictest0-21swapper/111:51:151
1583692240,3sleep10-21swapper/112:31:201
4030171992313,2cyclictest0-21swapper/211:44:262
4030169992319,2cyclictest4136825-21cron08:55:001
4030171992219,2cyclictest4182050-21fschecks_time09:41:192
4030169992218,2cyclictest0-21swapper/109:21:181
41016442203,4sleep30-21swapper/308:18:453
4030171992014,5cyclictest0-21swapper/207:11:312
4030164991912,5cyclictest8450irq/124-ahci[0000:00:12.0]07:10:010
40254722193,9sleep30-21swapper/307:06:133
4030171991713,2cyclictest4101782-21sendmail08:20:002
403017199162,2cyclictest0-21swapper/211:34:422
275472152,9sleep30-21swapper/310:21:133
41368122142,7sleep30-21swapper/308:55:013
40686632145,5sleep30-21swapper/307:46:223
919162132,6sleep30-21swapper/311:25:013
40910902132,7sleep30-21swapper/308:06:253
160462132,7sleep30-21swapper/310:06:243
1129572134,5sleep30-21swapper/311:46:243
876822122,6sleep30-21swapper/311:21:203
855342122,6sleep30-21swapper/311:16:233
779052122,6sleep30-21swapper/311:11:173
729812122,6sleep30-21swapper/311:06:193
65832122,6sleep30-21swapper/309:56:333
611632122,6sleep30-21swapper/310:51:263
568042122,6sleep30-21swapper/310:46:333
503132122,6sleep30-21swapper/310:41:233
503132122,6sleep30-21swapper/310:41:233
422922122,5sleep30-21swapper/310:35:013
41916052122,6sleep30-21swapper/309:51:153
41882502122,6sleep30-21swapper/309:46:253
41826542122,6sleep30-21swapper/309:41:243
41763502122,6sleep30-21swapper/309:34:213
41616322122,6sleep30-21swapper/309:20:013
41538052122,6sleep30-21swapper/309:11:213
41422932122,6sleep30-21swapper/309:01:153
41374792123,6sleep30-21swapper/308:56:373
41267522122,6sleep30-21swapper/308:45:013
41148192122,6sleep30-21swapper/308:31:213
41111102122,6sleep30-21swapper/308:26:433
41017952122,5sleep30-21swapper/308:20:003
40768402122,5sleep30-21swapper/307:55:013
40630822122,6sleep30-21swapper/307:41:213
40575532122,6sleep30-21swapper/307:36:153
40524302122,6sleep30-21swapper/307:31:133
40457222122,6sleep30-21swapper/307:21:223
40329042122,6sleep30-21swapper/307:11:233
223912122,6sleep30-21swapper/310:16:143
170712122,6sleep30-21swapper/310:10:013
1655472122,6sleep30-21swapper/312:36:253
1604592122,6sleep30-21swapper/312:31:233
1327332122,6sleep30-21swapper/312:06:193
1275932122,6sleep30-21swapper/312:01:173
1102692122,6sleep30-21swapper/311:41:233
1021672122,6sleep30-21swapper/311:36:333
1017572122,6sleep30-21swapper/311:35:013
75662112,5sleep30-21swapper/310:01:143
672412112,6sleep30-21swapper/311:00:323
623342112,5sleep30-21swapper/310:56:123
41668572112,5sleep30-21swapper/309:26:113
41668572112,5sleep30-21swapper/309:26:113
41569142112,6sleep30-21swapper/309:15:113
41476112111,6sleep30-21swapper/309:06:163
412622112,5sleep30-21swapper/310:31:243
41211562112,6sleep30-21swapper/308:36:353
40922742112,5sleep30-21swapper/308:11:143
40820902112,6sleep30-21swapper/308:00:473
40817512112,6sleep30-21swapper/307:59:433
40477182112,6sleep30-21swapper/307:26:163
40373532112,5sleep30-21swapper/307:16:173
327282112,5sleep30-21swapper/310:26:143
1515602112,6sleep30-21swapper/312:23:533
1420912112,5sleep30-21swapper/312:16:143
1414082112,6sleep30-21swapper/312:11:333
1259422112,5sleep30-21swapper/311:56:283
1166212110,6sleep30-21swapper/311:50:023
41225592101,5sleep30-21swapper/308:41:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional