You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 03:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue May 13, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
713099652,56cyclictest0-21swapper/220:32:072
170602620,5sleep118-21rcuc/118:12:241
313972613,12sleep00-21swapper/018:42:230
313972613,12sleep00-21swapper/018:42:230
7131996029,14cyclictest0-21swapper/318:37:233
7129996043,11cyclictest28749-21needreboot18:37:151
7131995929,13cyclictest0-21swapper/317:22:103
7131995929,13cyclictest0-21swapper/317:22:103
712799594,12cyclictest0-21swapper/021:16:450
7131995836,14cyclictest0-21swapper/318:17:263
7131995830,12cyclictest0-21swapper/321:26:563
7131995829,12cyclictest30968-21munin-node22:07:113
7131995729,12cyclictest0-21swapper/317:32:233
712799574,46cyclictest0-21swapper/019:22:110
7131995625,13cyclictest0-21swapper/321:47:043
713199562,39cyclictest0-21swapper/318:31:413
712799564,45cyclictest0-21swapper/019:37:040
227799560,5rtkit-daemon2276-21rtkit-daemon19:03:222
227799560,4rtkit-daemon2276-21rtkit-daemon20:45:413
180142563,10sleep118071-21aten_r1power_en18:17:051
7131995521,15cyclictest0-21swapper/321:52:103
7131995516,11cyclictest6848-21munin-run21:16:443
712799554,44cyclictest0-21swapper/017:12:270
712799553,46cyclictest0-21swapper/018:12:110
712799553,44cyclictest0-21swapper/017:57:400
7127995511,37cyclictest0-21swapper/018:32:240
246162553,10sleep20-21swapper/217:22:122
246162553,10sleep20-21swapper/217:22:122
227799550,6rtkit-daemon2276-21rtkit-daemon18:47:232
227799550,6rtkit-daemon2276-21rtkit-daemon18:47:232
227799550,5rtkit-daemon2276-21rtkit-daemon19:22:072
227799550,5rtkit-daemon2276-21rtkit-daemon17:17:112
176442552,47sleep10-21swapper/120:31:431
104942553,44sleep10-21swapper/121:22:091
92922543,10sleep00-21swapper/019:05:490
713199545,29cyclictest0-21swapper/319:12:183
713199545,29cyclictest0-21swapper/317:12:213
713199545,29cyclictest0-21swapper/316:47:253
7131995427,12cyclictest0-21swapper/318:03:103
7131995427,12cyclictest0-21swapper/318:03:103
7131995423,13cyclictest0-21swapper/320:22:053
7131995422,13cyclictest0-21swapper/317:52:123
7131995421,14cyclictest0-21swapper/321:37:093
7131995421,14cyclictest0-21swapper/321:37:093
7131995421,14cyclictest0-21swapper/320:26:593
7130995437,11cyclictest15988-21cpuspeed_turbos18:12:092
7130995421,20cyclictest1138-21snmpd16:56:322
712999544,10cyclictest0-21swapper/118:01:521
7129995432,10cyclictest0-21swapper/121:47:161
7127995434,12cyclictest19220-21strings18:17:180
283402542,45sleep10-21swapper/122:01:421
227799540,5rtkit-daemon2276-21rtkit-daemon21:32:093
227799540,5rtkit-daemon2276-21rtkit-daemon20:22:042
227799540,5rtkit-daemon2276-21rtkit-daemon19:47:132
227799540,5rtkit-daemon2276-21rtkit-daemon19:32:142
227799540,5rtkit-daemon2276-21rtkit-daemon19:27:062
227799540,5rtkit-daemon2276-21rtkit-daemon19:27:062
227799540,5rtkit-daemon2276-21rtkit-daemon19:12:222
227799540,4rtkit-daemon2276-21rtkit-daemon20:08:052
227799540,4rtkit-daemon2276-21rtkit-daemon20:08:052
126052542,9sleep10-21swapper/120:18:121
8942533,9sleep00-21swapper/022:11:450
713199536,26cyclictest0-21swapper/321:16:573
713199535,29cyclictest0-21swapper/319:47:223
713199535,29cyclictest0-21swapper/319:02:143
713199535,29cyclictest0-21swapper/317:37:213
713199535,29cyclictest0-21swapper/317:02:103
713199535,28cyclictest0-21swapper/320:12:243
713199534,25cyclictest0-21swapper/318:32:123
7131995325,12cyclictest0-21swapper/317:07:243
7131995321,9cyclictest22556-21systemd-cgroups18:26:503
7131995320,14cyclictest0-21swapper/321:22:033
7131995316,14cyclictest0-21swapper/320:06:473
7131995315,29cyclictest32319-21nscd18:01:523
7131995313,15cyclictest0-21swapper/317:31:543
712999535,11cyclictest0-21swapper/116:52:271
7129995331,10cyclictest0-21swapper/117:41:531
712999533,10cyclictest0-21swapper/119:50:081
712799535,30cyclictest0-21swapper/018:52:120
230902533,42sleep30-21swapper/317:17:253
227799530,5rtkit-daemon2276-21rtkit-daemon20:12:122
227799530,5rtkit-daemon2276-21rtkit-daemon18:57:222
227799530,5rtkit-daemon2276-21rtkit-daemon18:52:152
102652534,9sleep00-21swapper/020:13:480
78102523,9sleep00-21swapper/020:07:520
78102523,9sleep00-21swapper/020:07:520
713199525,37cyclictest0-21swapper/319:37:003
713199525,29cyclictest0-21swapper/318:12:093
713199525,28cyclictest0-21swapper/321:57:093
713199525,28cyclictest0-21swapper/321:07:183
713199525,28cyclictest0-21swapper/319:07:073
713199525,28cyclictest0-21swapper/317:42:113
713199525,27cyclictest0-21swapper/318:57:093
713199524,28cyclictest0-21swapper/321:06:463
713199524,28cyclictest0-21swapper/320:21:473
713199524,26cyclictest311-21seq18:47:063
713199524,26cyclictest311-21seq18:47:063
713199524,23cyclictest0-21swapper/319:17:143
713199523,27cyclictest0-21swapper/322:12:033
713199523,27cyclictest0-21swapper/317:47:193
7131995219,13cyclictest0-21swapper/319:22:043
7131995216,12cyclictest0-21swapper/322:06:423
712999525,13cyclictest0-21swapper/120:42:551
712999523,11cyclictest0-21swapper/120:06:591
712999523,11cyclictest0-21swapper/120:06:591
7129995226,21cyclictest0-21swapper/122:11:181
712799524,42cyclictest0-21swapper/021:07:050
7127995237,10cyclictest11094-21grep20:17:020
7127995214,20cyclictest0-21swapper/020:37:010
6032523,42sleep00-21swapper/019:54:420
30462522,44sleep10-21swapper/119:58:051
258802523,43sleep00-21swapper/021:55:490
227799520,5rtkit-daemon2276-21rtkit-daemon19:17:142
227799520,5rtkit-daemon2276-21rtkit-daemon18:43:013
227799520,5rtkit-daemon2276-21rtkit-daemon18:43:013
227799520,4rtkit-daemon2276-21rtkit-daemon19:52:132
191702523,10sleep119230-21proc_pri20:32:151
18152523,10sleep00-21swapper/018:48:160
18152523,10sleep00-21swapper/018:48:160
173822524,41sleep00-21swapper/020:28:190
173582522,9sleep20-21swapper/220:28:012
149812523,9sleep00-21swapper/018:07:280
134492523,9sleep013530-21gzip16:57:270
113772523,9sleep00-21swapper/021:23:370
713199515,28cyclictest0-21swapper/320:10:473
713199515,28cyclictest0-21swapper/320:10:473
713199515,26cyclictest0-21swapper/320:48:233
713199515,23cyclictest0-21swapper/321:41:583
713199514,29cyclictest0-21swapper/318:52:053
713199514,28cyclictest0-21swapper/318:11:533
713199514,25cyclictest777-21crond19:56:473
713199514,25cyclictest0-21swapper/319:32:023
713199513,28cyclictest0-21swapper/316:52:223
7131995126,9cyclictest27439-21munin-node20:52:213
7131995126,9cyclictest27439-21munin-node20:52:213
7131995115,13cyclictest0-21swapper/320:37:243
712999518,38cyclictest0-21swapper/120:47:071
712999514,10cyclictest0-21swapper/121:19:451
712999513,11cyclictest8513-21runrttasks20:12:021
712999513,11cyclictest0-21swapper/119:42:011
712799514,30cyclictest0-21swapper/017:02:100
38252513,9sleep00-21swapper/017:47:090
311842513,9sleep00-21swapper/017:36:570
289722513,41sleep129106-21sed20:52:221
289722513,41sleep129106-21sed20:52:221
284012512,9sleep20-21swapper/219:46:052
266842513,41sleep10-21swapper/117:27:111
227799510,5rtkit-daemon2276-21rtkit-daemon20:17:042
227799510,5rtkit-daemon2276-21rtkit-daemon19:42:133
227799510,4rtkit-daemon2276-21rtkit-daemon20:06:122
198192512,9sleep30-21swapper/320:34:023
198062513,41sleep00-21swapper/020:33:510
168762512,9sleep20-21swapper/217:06:572
713199503,27cyclictest0-21swapper/319:57:043
7129995037,8cyclictest2652-21cpuspeed_turbos21:06:591
7129995034,10cyclictest32555-21cpuspeed_turbos21:02:021
7129995025,20cyclictest0-21swapper/121:34:251
712799509,36cyclictest0-21swapper/020:52:140
712799509,36cyclictest0-21swapper/020:52:140
712799506,39cyclictest0-21swapper/016:52:120
712799505,28cyclictest0-21swapper/020:57:190
7127995034,10cyclictest29157-21cpuspeed_turbos17:32:070
7127995033,11cyclictest22173-21grep21:47:050
7127995033,11cyclictest1460-21unixbench-2d21:02:200
7127995033,10cyclictest19893-21grep19:27:060
7127995033,10cyclictest19893-21grep19:27:060
7127995018,26cyclictest28581-21munin-node22:02:120
68582503,41sleep00-21swapper/019:00:170
32342502,9sleep20-21swapper/222:16:432
28782502,41sleep10-21swapper/122:12:231
180452503,40sleep00-21swapper/021:37:150
180452503,40sleep00-21swapper/021:37:150
170672502,9sleep20-21swapper/221:37:012
170672502,9sleep20-21swapper/221:37:012
162502503,9sleep00-21swapper/021:34:490
7131994917,12cyclictest0-21swapper/316:57:223
713099494,28cyclictest0-21swapper/218:31:502
7130994933,10cyclictest10146-21df19:07:062
712999493,17cyclictest0-21swapper/118:07:261
712999493,10cyclictest0-21swapper/119:17:241
712999493,10cyclictest0-21swapper/119:05:151
7129994922,23cyclictest0-21swapper/121:42:341
712799495,27cyclictest0-21swapper/017:17:180
712799494,29cyclictest0-21swapper/018:22:160
712799493,26cyclictest0-21swapper/021:20:190
7127994919,10cyclictest11762-21latency_hist19:11:490
6332493,40sleep00-21swapper/022:11:290
233492493,40sleep00-21swapper/019:32:330
227799490,4rtkit-daemon2276-21rtkit-daemon18:43:382
227799490,4rtkit-daemon2276-21rtkit-daemon18:43:382
94522483,39sleep00-21swapper/016:51:270
78872482,10sleep10-21swapper/117:52:261
713099484,27cyclictest0-21swapper/217:47:222
713099483,41cyclictest0-21swapper/220:57:582
712999484,20cyclictest0-21swapper/121:29:281
7129994833,10cyclictest10815-21needreboot19:07:151
712999483,28cyclictest0-21swapper/116:51:561
712999483,12cyclictest0-21swapper/121:12:001
712999483,12cyclictest0-21swapper/118:22:271
712799484,27cyclictest0-21swapper/018:02:100
712799484,27cyclictest0-21swapper/018:02:100
7127994833,10cyclictest17234-21cpuspeed_turbos17:07:090
712799483,38cyclictest0-21swapper/017:42:260
7127994817,11cyclictest1040-21munin-node19:57:160
67822483,39sleep20-21swapper/221:16:012
293782483,39sleep00-21swapper/018:37:440
280132483,9sleep00-21swapper/021:57:260
246042483,10sleep00-21swapper/018:27:400
227799480,4rtkit-daemon2276-21rtkit-daemon16:42:203
205902483,39sleep00-21swapper/021:42:190
200892482,40sleep20-21swapper/218:21:012
153792482,9sleep20-21swapper/218:11:462
141382483,7sleep014217-21latency_hist19:16:490
131122483,9sleep00-21swapper/020:21:540
92022472,38sleep20-21swapper/221:21:212
713099473,26cyclictest0-21swapper/217:37:222
7130994718,13cyclictest0-21swapper/218:22:102
712999474,35cyclictest31604-21df_abs19:52:051
7129994733,9cyclictest23119-21cpuspeed_turbos18:27:081
712999473,37cyclictest0-21swapper/119:01:511
712999473,27cyclictest0-21swapper/117:01:541
712999473,12cyclictest0-21swapper/117:47:081
7129994721,21cyclictest0-21swapper/121:37:011
7129994721,21cyclictest0-21swapper/121:37:011
712799474,36cyclictest0-21swapper/017:22:130
712799474,36cyclictest0-21swapper/017:22:130
7127994736,7cyclictest3-21ksoftirqd/021:31:380
7127994732,9cyclictest24415-21sed20:42:230
712799473,38cyclictest0-21swapper/019:17:120
69522474,36sleep00-21swapper/016:45:070
43612472,39sleep10-21swapper/118:53:531
308072472,40sleep10-21swapper/117:35:011
307242473,7sleep130777-21latency_hist22:06:421
298182473,36sleep10-21swapper/120:56:541
269542472,39sleep00-21swapper/020:48:340
227799470,4rtkit-daemon2276-21rtkit-daemon19:57:132
210722472,38sleep30-21swapper/319:28:573
210722472,38sleep30-21swapper/319:28:573
202712472,9sleep10-21swapper/120:36:591
93322462,9sleep20-21swapper/216:49:522
7131994618,13cyclictest0-21swapper/320:57:213
713099463,26cyclictest0-21swapper/217:52:132
713099463,25cyclictest0-21swapper/222:10:342
713099463,24cyclictest29196-21grep20:52:232
713099463,24cyclictest29196-21grep20:52:232
712999464,38cyclictest0-21swapper/119:29:101
712999464,38cyclictest0-21swapper/119:29:101
712999464,36cyclictest0-21swapper/117:17:261
7129994631,9cyclictest24656-21head21:52:041
712999463,39cyclictest0-21swapper/118:02:221
712999463,39cyclictest0-21swapper/118:02:221
712999463,27cyclictest0-21swapper/117:02:061
306092462,9sleep20-21swapper/222:05:142
303812462,38sleep10-21swapper/118:42:081
303812462,38sleep10-21swapper/118:42:081
292792463,10sleep00-21swapper/019:47:080
285362463,37sleep00-21swapper/017:31:290
203972463,9sleep10-21swapper/117:12:201
161032462,9sleep20-21swapper/221:32:542
115782462,9sleep20-21swapper/221:26:172
713099453,35cyclictest0-21swapper/219:41:492
713099453,26cyclictest0-21swapper/221:42:182
713099453,26cyclictest0-21swapper/221:02:112
713099453,25cyclictest0-21swapper/217:12:152
712999454,18cyclictest0-21swapper/119:25:511
7129994530,9cyclictest5177-21ls20:02:221
712999453,26cyclictest0-21swapper/120:22:001
712999453,26cyclictest0-21swapper/118:47:231
712999453,26cyclictest0-21swapper/118:47:231
712799453,26cyclictest0-21swapper/019:42:180
7127994529,11cyclictest4394-21grep20:02:090
7127994516,12cyclictest0-21swapper/017:52:200
237982452,9sleep20-21swapper/221:51:482
163962452,9sleep20-21swapper/217:03:382
7130994431,8cyclictest3239-21grep21:07:062
713099443,35cyclictest0-21swapper/220:47:172
7130994429,10cyclictest2520-21grep17:42:182
7130994417,11cyclictest0-21swapper/218:37:252
7130994414,12cyclictest24085-21rt-features20:42:192
712999444,26cyclictest0-21swapper/117:22:251
712999444,26cyclictest0-21swapper/117:22:251
7129994430,9cyclictest17192-21tr17:07:091
7129994430,9cyclictest13265-21awk19:12:181
712999443,36cyclictest0-21swapper/118:32:211
712999443,36cyclictest0-21swapper/117:42:071
276232442,36sleep20-21swapper/221:57:162
7130994330,8cyclictest22303-21gltestperf21:47:062
713099433,25cyclictest0-21swapper/217:27:082
713099433,24cyclictest0-21swapper/216:57:192
712999438,20cyclictest108850irq/46-eth019:32:181
713099425,32cyclictest0-21swapper/217:57:152
7130994229,8cyclictest30554-21unixbench_singl17:32:272
712999423,25cyclictest0-21swapper/119:38:561
270872422,34sleep20-21swapper/218:33:592
127102422,9sleep20-21swapper/218:03:032
127102422,9sleep20-21swapper/218:03:032
713099413,23cyclictest0-21swapper/220:40:182
70262414,30sleep20-21swapper/216:46:052
713099403,31cyclictest0-21swapper/221:27:042
7129993715,16cyclictest0-21swapper/116:46:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional