You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 00:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Nov 17, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1123099923,34cyclictest0-21swapper/011:58:450
11230998734,10cyclictest20169-21unixbench_multi11:48:530
11230998734,10cyclictest20169-21unixbench_multi11:48:530
11234998536,42cyclictest29602-21taskset07:39:032
11234998436,41cyclictest4405-21cat12:23:522
11234998023,50cyclictest0-21swapper/211:28:202
11234997934,37cyclictest32560-21crond12:18:182
11234997928,33cyclictest0-21swapper/210:53:372
11234997734,36cyclictest19329-21head11:48:402
11234997734,36cyclictest19329-21head11:48:402
11234997729,32cyclictest0-21swapper/210:28:462
11234997729,31cyclictest11319-21aten2.4-expect11:33:322
11234997727,33cyclictest30150-21chrt12:13:032
11234997725,34cyclictest0-21swapper/210:33:402
11234997630,38cyclictest0-21swapper/207:58:442
11234997625,44cyclictest0-21swapper/211:57:042
11234997616,42cyclictest0-21swapper/211:38:332
11230997632,11cyclictest0-21swapper/007:49:030
11234997532,27cyclictest18585-21taskset07:18:312
11234997528,30cyclictest0-21swapper/207:33:562
11234997524,34cyclictest0-21swapper/207:53:592
11234997523,44cyclictest0-21swapper/211:08:552
11234997426,27cyclictest5793-21sed11:18:552
11234997425,41cyclictest0-21swapper/208:43:262
11234997422,46cyclictest0-21swapper/209:13:262
11234997329,26cyclictest3092-21ntpq08:58:552
11234997328,37cyclictest0-21swapper/210:48:522
11234997326,40cyclictest0-21swapper/207:28:542
11234997326,30cyclictest17049-21taskset09:28:472
11234997319,46cyclictest1369-21runrttasks11:07:562
11234997229,36cyclictest1243-21snmpd12:07:072
11234997228,37cyclictest1243-21snmpd10:41:532
11234997224,41cyclictest0-21swapper/210:03:242
11234997224,32cyclictest0-21swapper/210:03:492
11234997220,44cyclictest0-21swapper/207:43:452
11234997127,38cyclictest1243-21snmpd11:16:582
11234997126,39cyclictest0-21swapper/208:48:522
11234997122,42cyclictest0-21swapper/207:06:212
263212700,10sleep01123099cyclictest08:39:030
11234997032,29cyclictest9908-21munin-run10:23:232
11234997032,29cyclictest9908-21munin-run10:23:232
11234997028,36cyclictest20398-21sshd09:34:452
11234997028,36cyclictest20398-21sshd09:34:452
11234997026,24cyclictest29074-21munin-run08:48:262
11234997024,39cyclictest1243-21snmpd10:11:572
11234997023,40cyclictest0-21swapper/211:58:532
11234997022,41cyclictest0-21swapper/208:53:412
11234997022,41cyclictest0-21swapper/208:53:412
11234996925,37cyclictest0-21swapper/207:23:502
11234996925,29cyclictest623-21telnet07:48:452
11234996925,26cyclictest0-21swapper/210:26:572
11234996924,29cyclictest0-21swapper/210:58:522
11234996923,40cyclictest0-21swapper/210:13:562
11234996923,39cyclictest11380-21munin-node09:19:022
11234996923,39cyclictest0-21swapper/208:18:412
11234996922,40cyclictest0-21swapper/211:43:512
11234996920,43cyclictest0-21swapper/209:46:452
11234996917,45cyclictest0-21swapper/209:13:432
11234996917,35cyclictest0-21swapper/209:03:552
11234996746,15cyclictest0-21swapper/208:13:292
11234996739,21cyclictest23344-21head08:33:522
11234996723,36cyclictest21909-21latency_hist08:33:282
11234996631,29cyclictest1369-21runrttasks08:04:192
11234996626,33cyclictest19843-21telnet10:43:362
11234996625,34cyclictest425-21telnet12:18:322
11234996624,34cyclictest6215-21hwlatdetect12:28:432
11234996624,34cyclictest6215-21hwlatdetect12:28:432
11234996536,22cyclictest19046-21grep08:24:022
11234996534,25cyclictest0-21swapper/208:13:502
11234996534,25cyclictest0-21swapper/208:13:502
11234996527,33cyclictest0-21swapper/207:09:052
11234996524,28cyclictest0-21swapper/209:51:462
11234996515,31cyclictest0-21swapper/207:19:002
11234996422,28cyclictest0-21swapper/209:56:472
11234996418,30cyclictest0-21swapper/209:38:592
42452630,7sleep34243-21uname07:53:553
11235996319,27cyclictest25791-21aten_r1power_fr09:48:403
11234996330,27cyclictest0-21swapper/209:23:492
11234996239,16cyclictest10022-21chrt11:28:462
240862613,50sleep30-21swapper/310:51:403
11234996120,30cyclictest0-21swapper/207:03:312
1123399603,41cyclictest0-21swapper/109:26:561
1123599572,22cyclictest0-21swapper/308:29:203
111912574,6sleep00-21swapper/007:03:270
254792564,11sleep30-21swapper/308:38:513
243799560,5rtkit-daemon2436-21rtkit-daemon07:03:303
11235995639,11cyclictest7473-21gltestperf09:08:473
11233995623,15cyclictest0-21swapper/107:24:001
11233995617,12cyclictest18659-21aten_r1power_po09:33:391
11233995617,12cyclictest18659-21aten_r1power_po09:33:391
209222553,44sleep10-21swapper/109:38:381
1123599544,30cyclictest0-21swapper/311:13:543
73122533,43sleep10-21swapper/107:59:591
40132534,9sleep10-21swapper/109:03:281
323472533,9sleep30-21swapper/312:15:353
1123599534,30cyclictest0-21swapper/311:33:323
1123599534,29cyclictest0-21swapper/310:53:573
1123399536,28cyclictest0-21swapper/110:06:481
1123399536,27cyclictest0-21swapper/111:28:491
1123399534,29cyclictest0-21swapper/107:34:001
11233995325,8cyclictest20701-21cat11:53:201
11233995325,8cyclictest20701-21cat11:53:201
11233995322,13cyclictest0-21swapper/110:23:591
1123099533,44cyclictest0-21swapper/010:53:580
108142532,44sleep30-21swapper/309:14:183
301142522,9sleep30-21swapper/312:12:373
270552522,43sleep00-21swapper/012:03:510
254022522,9sleep30-21swapper/307:31:553
22922522,44sleep00-21swapper/012:19:030
1123599524,29cyclictest0-21swapper/308:43:523
11235995234,11cyclictest14047-21cpuspeed_turbos11:38:363
1123399525,28cyclictest0-21swapper/112:28:421
1123399525,28cyclictest0-21swapper/112:28:421
1123399525,28cyclictest0-21swapper/109:28:391
1123399525,28cyclictest0-21swapper/109:08:561
1123399525,28cyclictest0-21swapper/107:03:571
1123399524,30cyclictest0-21swapper/111:43:441
1123399524,28cyclictest0-21swapper/110:38:231
11233995232,12cyclictest9619-21vmstat08:04:041
1123399523,43cyclictest0-21swapper/111:16:031
11233995225,10cyclictest21956-21cat10:48:221
11233995224,9cyclictest5142-21awk10:13:231
11233995224,8cyclictest30220-21cat12:13:181
11233995220,13cyclictest0-21swapper/110:58:581
96682512,42sleep00-21swapper/008:04:330
75422514,40sleep00-21swapper/008:03:000
312142513,9sleep10-21swapper/111:05:561
172852512,9sleep30-21swapper/310:38:253
158522513,42sleep10-21swapper/107:11:541
1123599514,29cyclictest0-21swapper/307:28:303
1123599514,28cyclictest0-21swapper/311:08:563
1123599514,28cyclictest0-21swapper/310:43:463
1123599514,28cyclictest0-21swapper/310:23:373
1123599514,28cyclictest0-21swapper/309:23:413
1123599514,28cyclictest0-21swapper/308:58:523
1123399515,28cyclictest0-21swapper/108:43:481
1123399515,27cyclictest0-21swapper/112:02:061
1123399515,27cyclictest0-21swapper/108:14:051
1123399515,27cyclictest0-21swapper/108:14:051
11233995132,12cyclictest16444-21munin-node08:19:001
11233995123,9cyclictest10064-21cat10:23:241
11233995123,9cyclictest10064-21cat10:23:241
11233995119,13cyclictest0-21swapper/111:53:401
98152502,42sleep00-21swapper/010:22:220
98152502,42sleep00-21swapper/010:22:220
60322502,41sleep00-21swapper/009:04:110
56372503,40sleep30-21swapper/309:03:583
325352503,41sleep00-21swapper/012:18:020
323992502,41sleep30-21swapper/310:00:213
1123599504,28cyclictest0-21swapper/311:53:333
1123599504,28cyclictest0-21swapper/310:18:533
1123599504,28cyclictest0-21swapper/310:18:533
1123599504,28cyclictest0-21swapper/310:13:443
1123599504,28cyclictest0-21swapper/307:13:433
1123599504,27cyclictest0-21swapper/311:03:453
1123599504,27cyclictest0-21swapper/307:44:023
11235995026,8cyclictest17132-21crond08:23:283
11235995019,13cyclictest0-21swapper/310:58:443
11235995019,13cyclictest0-21swapper/308:48:493
1123399505,27cyclictest0-21swapper/110:48:351
1123399504,28cyclictest0-21swapper/107:38:551
1123399504,27cyclictest0-21swapper/110:14:001
11233995031,12cyclictest4113-21strings12:23:461
11233995022,13cyclictest0-21swapper/109:53:541
11233995020,13cyclictest0-21swapper/107:51:141
1123099504,40cyclictest0-21swapper/009:03:270
11230995034,10cyclictest13102-21grep09:19:000
1123099503,42cyclictest0-21swapper/008:10:310
87132495,38sleep00-21swapper/009:13:020
60422493,9sleep10-21swapper/111:20:191
51402493,39sleep10-21swapper/107:57:451
273482492,39sleep00-21swapper/008:43:440
193162492,41sleep00-21swapper/010:41:450
169722492,41sleep30-21swapper/310:37:173
122772492,40sleep30-21swapper/308:12:263
1123599494,28cyclictest0-21swapper/312:18:403
1123599494,27cyclictest0-21swapper/312:03:403
1123599494,27cyclictest0-21swapper/307:48:463
1123599494,27cyclictest0-21swapper/307:04:033
1123599494,25cyclictest0-21swapper/311:46:353
1123599494,12cyclictest0-21swapper/312:02:063
11235994933,10cyclictest3226-21tr12:23:353
11235994931,11cyclictest8182-21tr08:03:443
1123599493,25cyclictest0-21swapper/309:44:463
1123599493,25cyclictest0-21swapper/307:18:443
1123399495,26cyclictest0-21swapper/110:01:591
1123399495,26cyclictest0-21swapper/109:16:401
1123399495,26cyclictest0-21swapper/108:55:501
1123399495,26cyclictest0-21swapper/108:55:501
1123399495,26cyclictest0-21swapper/108:48:391
1123399494,39cyclictest1369-21runrttasks12:20:441
1123399494,27cyclictest0-21swapper/108:38:481
11233994931,10cyclictest26442-21tr12:03:401
11233994929,15cyclictest0-21swapper/110:28:531
11233994929,11cyclictest26010-21cut09:48:421
1123099493,41cyclictest0-21swapper/008:51:280
1123099493,40cyclictest0-21swapper/007:19:010
72432482,40sleep30-21swapper/312:30:513
72432482,40sleep30-21swapper/312:30:513
286862484,37sleep00-21swapper/010:59:060
263282483,39sleep10-21swapper/110:54:321
121212482,40sleep00-21swapper/010:26:130
1123599484,28cyclictest0-21swapper/308:13:433
1123599484,28cyclictest0-21swapper/308:13:433
1123599484,27cyclictest0-21swapper/309:33:533
1123599484,27cyclictest0-21swapper/309:33:533
1123599484,26cyclictest0-21swapper/310:06:483
11235994831,10cyclictest32574-21cut08:53:493
11235994831,10cyclictest32574-21cut08:53:493
1123599483,27cyclictest0-21swapper/309:53:513
11235994818,13cyclictest0-21swapper/311:48:523
11235994818,13cyclictest0-21swapper/311:48:523
11235994818,13cyclictest0-21swapper/307:58:423
11235994816,15cyclictest0-21swapper/310:31:513
1123399483,26cyclictest0-21swapper/111:11:571
1123399483,26cyclictest0-21swapper/107:18:311
11233994823,20cyclictest0-21swapper/107:30:551
11233994821,8cyclictest20877-21cat07:23:301
1123099483,19cyclictest0-21swapper/012:08:440
173612472,37sleep00-21swapper/008:23:320
1123599474,37cyclictest29034-21gltestperf07:38:513
1123599474,26cyclictest0-21swapper/311:21:583
11233994730,12cyclictest22480-21tr08:33:411
11233994726,14cyclictest0-21swapper/111:38:531
11233994717,12cyclictest0-21swapper/111:23:491
1123099473,39cyclictest0-21swapper/011:28:540
1123099473,39cyclictest0-21swapper/011:13:300
1123099473,39cyclictest0-21swapper/007:29:050
1123099473,12cyclictest0-21swapper/009:48:390
11230994726,15cyclictest0-21swapper/010:38:220
11230994721,12cyclictest0-21swapper/010:03:400
11230994717,9cyclictest30302-21crond07:43:290
11230994717,13cyclictest0-21swapper/009:13:490
109882472,38sleep30-21swapper/311:32:393
84932462,38sleep00-21swapper/011:26:110
296342462,37sleep00-21swapper/009:54:010
276112462,38sleep30-21swapper/307:34:333
157992462,37sleep30-21swapper/307:11:113
155852464,9sleep00-21swapper/011:40:130
146282462,39sleep00-21swapper/008:16:590
146282462,39sleep00-21swapper/008:16:590
131742463,36sleep10-21swapper/111:34:541
1123599464,35cyclictest0-21swapper/309:38:383
1123599464,25cyclictest0-21swapper/309:32:213
1123599464,24cyclictest1369-21runrttasks08:33:393
11235994619,12cyclictest0-21swapper/309:21:413
1123399464,35cyclictest0-21swapper/107:43:421
1123399464,23cyclictest32221-21yum12:13:571
11233994629,10cyclictest18229-21gltestperf08:23:491
11233994619,8cyclictest25519-21cat09:48:251
11233994619,8cyclictest0-21swapper/109:03:271
11233994616,12cyclictest0-21swapper/110:38:371
11230994631,9cyclictest22452-21cut08:33:410
1123099463,9cyclictest22579-21unixbench-2d09:38:590
1123099463,36cyclictest0-21swapper/007:43:460
10772464,35sleep00-21swapper/011:09:460
73392452,9sleep00-21swapper/012:32:040
73392452,9sleep00-21swapper/012:32:040
276082452,37sleep00-21swapper/007:34:300
146032452,37sleep00-21swapper/010:32:300
1123599454,33cyclictest0-21swapper/311:28:213
1123599454,24cyclictest0-21swapper/308:24:053
1123599454,13cyclictest0-21swapper/310:08:393
1123399454,33cyclictest0-21swapper/109:18:541
11233994528,12cyclictest0-21swapper/108:11:581
1123399452,25cyclictest0-21swapper/108:28:511
1123099454,36cyclictest0-21swapper/010:48:400
1123099453,37cyclictest0-21swapper/011:18:490
1123099453,37cyclictest0-21swapper/007:58:280
11230994519,9cyclictest1447-21latency_hist08:58:270
11230994519,9cyclictest1447-21latency_hist08:58:270
11230994519,12cyclictest0-21swapper/010:08:500
181562442,36sleep00-21swapper/007:15:480
1123099445,33cyclictest0-21swapper/007:04:050
1123099443,35cyclictest0-21swapper/011:43:490
11230994428,10cyclictest22763-21grep07:24:050
11230994426,12cyclictest0-21swapper/011:53:360
323472432,36sleep00-21swapper/009:59:410
217842432,36sleep00-21swapper/008:31:580
1123099434,33cyclictest0-21swapper/012:23:350
1123099434,33cyclictest0-21swapper/011:33:500
1123099434,12cyclictest0-21swapper/010:13:580
1123099433,35cyclictest0-21swapper/008:18:490
1123099433,19cyclictest0-21swapper/009:48:240
11230994318,7cyclictest18300-21latency_hist09:33:260
1123099423,32cyclictest0-21swapper/009:23:370
1123099416,31cyclictest0-21swapper/007:08:530
1123099413,34cyclictest0-21swapper/009:33:540
1123099413,34cyclictest0-21swapper/009:33:540
1123099413,33cyclictest0-21swapper/010:45:370
1123099403,33cyclictest0-21swapper/011:05:560
1123399393,19cyclictest11253-21latency_hist07:03:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional