You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 16:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Dec 05, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1109421080,5sleep111095-21cat11:21:581
243799920,8rtkit-daemon0-21swapper/006:46:532
243799780,6rtkit-daemon0-21swapper/306:46:450
243799780,5rtkit-daemon2436-21rtkit-daemon09:47:013
3201996735,26cyclictest0-21swapper/110:46:471
320499654,34cyclictest0-21swapper/310:45:323
3202996533,13cyclictest0-21swapper/212:01:482
81022644,12sleep20-21swapper/210:11:282
265112623,51sleep00-21swapper/010:46:560
3202996123,20cyclictest0-21swapper/209:13:572
3202996031,13cyclictest0-21swapper/208:16:342
320499594,48cyclictest0-21swapper/310:16:293
3202995830,13cyclictest0-21swapper/211:01:442
3202995830,12cyclictest0-21swapper/210:16:282
320499574,46cyclictest0-21swapper/309:56:453
320499574,46cyclictest0-21swapper/308:37:193
3201995735,17cyclictest28455-21awk08:31:311
66352562,18sleep20-21swapper/211:13:302
320499564,44cyclictest0-21swapper/311:19:303
320499563,45cyclictest0-21swapper/309:32:023
3202995630,11cyclictest0-21swapper/209:26:452
320099563,48cyclictest0-21swapper/012:05:060
243799560,5rtkit-daemon2436-21rtkit-daemon08:41:182
243799560,5rtkit-daemon2436-21rtkit-daemon07:41:202
215682560,5sleep20-21swapper/211:46:382
320499554,45cyclictest0-21swapper/312:06:433
3202995529,12cyclictest0-21swapper/207:26:352
243799550,5rtkit-daemon2436-21rtkit-daemon09:46:532
320499546,14cyclictest0-21swapper/307:10:353
320499545,42cyclictest0-21swapper/307:50:293
320499544,42cyclictest0-21swapper/310:52:553
320499544,42cyclictest0-21swapper/308:17:303
3202995427,12cyclictest0-21swapper/212:06:512
3200995418,22cyclictest0-21swapper/007:16:540
312772543,43sleep00-21swapper/012:06:400
243799540,6rtkit-daemon2436-21rtkit-daemon11:51:412
243799540,5rtkit-daemon2436-21rtkit-daemon12:01:252
243799540,5rtkit-daemon2436-21rtkit-daemon09:41:162
243799540,5rtkit-daemon2436-21rtkit-daemon09:31:542
243799540,5rtkit-daemon2436-21rtkit-daemon09:21:462
243799540,5rtkit-daemon2436-21rtkit-daemon08:46:402
243799540,5rtkit-daemon2436-21rtkit-daemon08:46:402
222542542,10sleep30-21swapper/310:39:093
320499536,39cyclictest0-21swapper/310:26:293
320499535,41cyclictest0-21swapper/307:15:203
320499535,10cyclictest6193-21systemd-cgroups06:56:363
320499534,44cyclictest0-21swapper/307:21:013
320499534,43cyclictest0-21swapper/312:01:453
320499534,43cyclictest0-21swapper/310:56:463
320499534,42cyclictest2244-21tail12:11:453
320499534,42cyclictest0-21swapper/309:26:403
3204995338,9cyclictest10397-21tail09:06:513
3202995337,10cyclictest4052-21unixbench_multi11:06:592
3202995327,12cyclictest0-21swapper/207:08:282
3200995338,11cyclictest0-21swapper/008:04:420
3200995337,11cyclictest0-21swapper/009:41:470
3200995319,28cyclictest6600-21fschecks_count10:06:470
300752532,43sleep00-21swapper/008:31:590
243799530,5rtkit-daemon2436-21rtkit-daemon12:11:402
243799530,5rtkit-daemon2436-21rtkit-daemon08:31:482
211152534,42sleep00-21swapper/008:00:110
162952533,43sleep00-21swapper/011:35:040
91082523,42sleep10-21swapper/111:19:381
88592523,9sleep00-21swapper/007:02:360
58232524,40sleep20-21swapper/208:56:522
320499524,42cyclictest0-21swapper/310:11:293
320499524,42cyclictest0-21swapper/307:06:363
320199523,43cyclictest0-21swapper/108:52:581
320199523,43cyclictest0-21swapper/108:52:581
3201995224,23cyclictest0-21swapper/108:02:301
3200995230,13cyclictest0-21swapper/010:16:450
3200995230,13cyclictest0-21swapper/010:16:450
3200995225,9cyclictest6787-21latency_hist07:01:350
3200995224,22cyclictest0-21swapper/008:19:380
319662522,9sleep30-21swapper/308:45:203
318132523,41sleep00-21swapper/008:43:200
243799520,5rtkit-daemon2436-21rtkit-daemon09:16:542
243799520,5rtkit-daemon2436-21rtkit-daemon09:01:472
243799520,5rtkit-daemon2436-21rtkit-daemon07:01:592
239212523,42sleep10-21swapper/108:07:381
60352512,42sleep10-21swapper/106:54:511
320499514,43cyclictest0-21swapper/311:21:503
320499514,42cyclictest0-21swapper/310:17:013
320499514,42cyclictest0-21swapper/310:17:013
320499514,42cyclictest0-21swapper/309:02:053
320499514,41cyclictest0-21swapper/309:41:303
320499514,41cyclictest0-21swapper/308:51:533
320499514,41cyclictest0-21swapper/308:51:533
320499514,40cyclictest0-21swapper/310:26:413
3202995136,9cyclictest19539-21grep07:47:062
320099514,22cyclictest0-21swapper/010:01:280
3200995125,8cyclictest29608-21latency_hist10:56:270
306622513,41sleep00-21swapper/009:49:130
302472513,8sleep330378-21unixbench_multi08:32:023
293902512,42sleep10-21swapper/110:53:461
29312513,42sleep00-21swapper/012:12:280
243799510,5rtkit-daemon2436-21rtkit-daemon09:41:312
243799510,5rtkit-daemon2436-21rtkit-daemon08:00:502
243799510,5rtkit-daemon2436-21rtkit-daemon07:28:132
204722512,9sleep00-21swapper/007:54:470
103762512,42sleep00-21swapper/010:15:040
101662513,9sleep10-21swapper/110:12:191
90852502,9sleep00-21swapper/009:03:150
56962503,40sleep00-21swapper/008:56:500
320499505,28cyclictest0-21swapper/309:00:443
320499504,40cyclictest0-21swapper/311:06:433
320499503,42cyclictest0-21swapper/310:51:273
3204995019,11cyclictest0-21swapper/311:41:593
3202995037,8cyclictest1369-21runrttasks10:03:152
3202995034,9cyclictest6176-21crond06:56:362
3201995038,8cyclictest5798-21if_eth008:56:501
3201995024,9cyclictest25038-21cat10:46:271
320099505,39cyclictest0-21swapper/009:16:300
320099504,28cyclictest0-21swapper/011:31:100
3200995024,11cyclictest0-21swapper/007:25:220
3200995023,12cyclictest0-21swapper/009:26:300
3200995022,12cyclictest0-21swapper/008:26:320
320099502,37cyclictest0-21swapper/010:28:020
275002502,9sleep30-21swapper/308:22:193
252932502,10sleep00-21swapper/011:51:570
243799500,5rtkit-daemon2436-21rtkit-daemon08:21:342
243799500,5rtkit-daemon2436-21rtkit-daemon07:36:362
23352503,9sleep00-21swapper/011:06:390
174922503,9sleep10-21swapper/107:45:011
163682502,9sleep10-21swapper/107:36:311
138422502,41sleep10-21swapper/107:29:421
91502492,42sleep10-21swapper/107:06:241
91022492,41sleep00-21swapper/011:19:330
58182493,39sleep00-21swapper/006:52:000
4282493,39sleep0590-21fschecks_time08:46:460
4282493,39sleep0590-21fschecks_time08:46:460
320499494,39cyclictest0-21swapper/311:56:533
320499493,24cyclictest0-21swapper/309:16:563
3202994934,9cyclictest31918-21grep09:51:472
320299493,28cyclictest0-21swapper/208:26:322
3201994921,11cyclictest16732-21munin-node09:22:001
320199492,42cyclictest0-21swapper/108:01:211
320099494,28cyclictest0-21swapper/007:45:280
3200994924,9cyclictest26242-21aten_r1power_cu11:56:350
3200994922,12cyclictest0-21swapper/010:34:300
3200994921,13cyclictest0-21swapper/008:54:030
3200994921,13cyclictest0-21swapper/008:54:030
310542492,40sleep00-21swapper/008:36:390
284242492,9sleep00-21swapper/008:31:230
259052492,9sleep10-21swapper/111:55:321
243799490,5rtkit-daemon2436-21rtkit-daemon08:52:332
243799490,5rtkit-daemon2436-21rtkit-daemon08:52:332
243799490,5rtkit-daemon2436-21rtkit-daemon07:16:512
211672493,40sleep00-21swapper/009:30:150
210412494,38sleep20-21swapper/210:36:472
185572493,40sleep00-21swapper/011:38:100
169832493,39sleep00-21swapper/007:41:170
114462493,10sleep10-21swapper/109:07:551
100782492,40sleep00-21swapper/007:12:360
84582483,38sleep10-21swapper/109:01:591
67512483,9sleep10-21swapper/107:01:121
320499485,38cyclictest0-21swapper/311:36:543
320499483,24cyclictest0-21swapper/311:31:503
3202994831,10cyclictest19637-21unixbench_singl10:32:012
3202994831,10cyclictest1890-21gltestperf09:56:472
320299483,28cyclictest0-21swapper/208:01:552
3202994825,11cyclictest0-21swapper/210:46:022
3202994817,25cyclictest15604-21aten_r1power_po10:26:402
3202994814,20cyclictest0-21swapper/207:41:402
3201994827,15cyclictest0-21swapper/108:31:471
3201994824,10cyclictest0-21swapper/111:56:421
3201994820,13cyclictest0-21swapper/108:46:311
3200994830,12cyclictest0-21swapper/010:36:470
320099483,39cyclictest0-21swapper/011:41:490
3200994828,14cyclictest0-21swapper/010:56:520
3200994828,14cyclictest0-21swapper/007:31:350
3200994825,10cyclictest0-21swapper/009:16:580
3200994824,7cyclictest24230-21latency_hist08:11:340
3200994822,12cyclictest0-21swapper/007:11:360
320099482,40cyclictest0-21swapper/007:31:370
305542482,40sleep10-21swapper/109:47:491
305532482,9sleep10-21swapper/112:03:551
281372482,10sleep30-21swapper/308:27:393
247832482,9sleep00-21swapper/010:45:550
246422482,39sleep00-21swapper/008:14:060
238832482,9sleep30-21swapper/308:07:083
149692482,40sleep00-21swapper/010:22:460
130582482,9sleep10-21swapper/107:22:241
78352473,38sleep10-21swapper/110:08:001
320499472,9cyclictest0-21swapper/308:15:223
320499472,9cyclictest0-21swapper/306:57:033
3204994715,10cyclictest0-21swapper/308:51:213
3204994715,10cyclictest0-21swapper/308:51:213
320299474,26cyclictest0-21swapper/210:46:522
320299474,26cyclictest0-21swapper/208:27:302
320299473,27cyclictest0-21swapper/211:31:402
3202994724,11cyclictest0-21swapper/210:55:172
3202994724,11cyclictest0-21swapper/208:10:382
3202994718,11cyclictest0-21swapper/211:26:422
3202994718,11cyclictest0-21swapper/208:42:462
3201994732,11cyclictest0-21swapper/111:07:021
3201994723,12cyclictest0-21swapper/110:01:421
320099475,36cyclictest0-21swapper/009:07:050
3200994727,14cyclictest0-21swapper/009:36:400
3200994722,8cyclictest3618-21basename10:01:410
3200994721,12cyclictest0-21swapper/011:16:260
3200994719,12cyclictest0-21swapper/009:51:460
314042472,38sleep10-21swapper/108:40:591
275702473,37sleep10-21swapper/108:23:141
271472472,39sleep10-21swapper/108:20:401
216132473,38sleep00-21swapper/009:31:440
204202472,9sleep30-21swapper/307:54:063
147612473,37sleep314800-21diskstats07:31:493
126492472,39sleep20-21swapper/210:18:372
126492472,39sleep20-21swapper/210:18:372
115762472,10sleep20-21swapper/209:09:382
100542473,9sleep10-21swapper/107:12:171
5472462,9sleep10-21swapper/112:09:511
320499464,37cyclictest0-21swapper/311:51:533
320499464,37cyclictest0-21swapper/310:02:013
320499464,37cyclictest0-21swapper/309:21:583
320499464,35cyclictest11984-21aten2.4-expect09:11:393
320499462,9cyclictest0-21swapper/309:51:413
320499462,9cyclictest0-21swapper/306:48:043
320299463,36cyclictest7103-21munin-node11:16:492
3202994629,11cyclictest13110-21munin-node10:21:532
3202994622,12cyclictest0-21swapper/211:41:382
320299462,35cyclictest9583-21telnet11:21:382
320299462,30cyclictest0-21swapper/210:58:162
3202994618,11cyclictest0-21swapper/207:55:262
3201994628,13cyclictest0-21swapper/106:46:371
3201994621,8cyclictest18005-21aten_r1power_po10:31:401
3201994616,9cyclictest2302-21cat08:51:321
3201994616,9cyclictest2302-21cat08:51:321
30562463,9sleep10-21swapper/112:14:061
284222462,38sleep10-21swapper/109:46:081
234192462,38sleep10-21swapper/109:33:301
162592462,38sleep10-21swapper/111:34:371
137642463,37sleep10-21swapper/111:28:081
95572452,37sleep10-21swapper/107:08:461
320499454,36cyclictest0-21swapper/311:26:383
320499452,9cyclictest0-21swapper/311:14:453
320299453,26cyclictest0-21swapper/207:15:442
320299453,11cyclictest0-21swapper/211:37:012
320099453,36cyclictest0-21swapper/007:46:460
318632452,37sleep10-21swapper/110:59:551
258782452,9sleep10-21swapper/109:39:071
222302453,9sleep10-21swapper/110:38:511
211712452,37sleep10-21swapper/111:46:051
211632452,38sleep10-21swapper/109:30:121
17372452,9sleep00-21swapper/011:03:330
167742453,9sleep30-21swapper/307:38:383
129982452,36sleep30-21swapper/307:21:383
127352453,36sleep10-21swapper/107:21:071
7812442,9sleep10-21swapper/111:01:481
54172443,9sleep10-21swapper/106:49:441
320499444,12cyclictest0-21swapper/311:01:463
320499442,25cyclictest0-21swapper/308:02:003
3202994422,11cyclictest0-21swapper/207:01:032
3201994423,10cyclictest0-21swapper/108:15:321
3201994419,9cyclictest32485-21sshd09:51:571
3201994416,9cyclictest7150irq/45-ahci11:41:251
320099443,24cyclictest9489-21munin-node11:21:530
3200994418,11cyclictest0-21swapper/011:46:530
3200994416,12cyclictest0-21swapper/006:46:370
234002442,36sleep10-21swapper/111:49:001
199332442,36sleep10-21swapper/107:50:411
197342442,36sleep30-21swapper/310:32:413
176052442,36sleep10-21swapper/110:31:011
66962432,36sleep10-21swapper/111:14:181
320499434,14cyclictest0-21swapper/309:41:443
320499432,22cyclictest0-21swapper/307:57:413
320299433,26cyclictest0-21swapper/206:46:372
3201994328,9cyclictest14035-21hwlatdetect10:21:501
3201994326,12cyclictest0-21swapper/109:56:411
3201994321,8cyclictest15428-21latency09:16:531
129522433,33sleep10-21swapper/109:11:501
3204994219,11cyclictest0-21swapper/307:45:273
3201994222,15cyclictest0-21swapper/107:41:341
234172422,34sleep30-21swapper/311:49:143
138812422,33sleep30-21swapper/307:30:123
320199413,33cyclictest0-21swapper/107:54:251
320199412,8cyclictest11299-21diskstats10:16:431
320199412,8cyclictest11299-21diskstats10:16:431
28242414,6sleep30-21swapper/306:42:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional