You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 05:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed Nov 26, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
243799960,6rtkit-daemon0-21swapper/222:50:022
2413699914,12cyclictest0-21swapper/222:25:462
2413699914,12cyclictest0-21swapper/220:50:272
2413699914,10cyclictest30352-21open_inodes21:20:572
2413699914,10cyclictest30352-21open_inodes21:20:572
2413699904,12cyclictest0-21swapper/223:10:452
24136999016,49cyclictest0-21swapper/200:20:392
2413699894,15cyclictest0-21swapper/218:55:312
24136998919,48cyclictest0-21swapper/219:45:522
2413699884,60cyclictest0-21swapper/220:32:522
24136998820,45cyclictest0-21swapper/219:41:022
24136998811,9cyclictest1618-21nscd21:35:252
2413699875,58cyclictest0-21swapper/223:43:212
2413699874,62cyclictest0-21swapper/222:50:402
2413699874,59cyclictest0-21swapper/220:37:532
2413699874,59cyclictest0-21swapper/220:37:532
2413699873,13cyclictest0-21swapper/223:05:212
2413699864,13cyclictest0-21swapper/222:15:532
2413699864,12cyclictest0-21swapper/223:50:522
2413699863,12cyclictest0-21swapper/219:51:002
2413599864,74cyclictest0-21swapper/123:20:451
2413699854,13cyclictest0-21swapper/200:10:512
2413699854,13cyclictest0-21swapper/200:10:512
2413699854,12cyclictest0-21swapper/220:15:532
2413699854,12cyclictest0-21swapper/219:35:302
2413599854,73cyclictest0-21swapper/121:50:241
2413699844,65cyclictest0-21swapper/220:00:532
2413699844,64cyclictest0-21swapper/219:35:452
2413699844,14cyclictest0-21swapper/222:00:522
2413699844,14cyclictest0-21swapper/222:00:522
2413699837,10cyclictest0-21swapper/221:25:582
2413699834,63cyclictest0-21swapper/220:12:492
2413699834,60cyclictest30382-21runrttasks19:05:572
2413699834,13cyclictest0-21swapper/221:51:012
2413699834,12cyclictest0-21swapper/221:35:482
2413699834,12cyclictest0-21swapper/200:16:102
24136998314,51cyclictest0-21swapper/220:23:002
2413599834,72cyclictest0-21swapper/123:10:541
2413599834,72cyclictest0-21swapper/120:40:401
2413599833,72cyclictest0-21swapper/122:25:381
2413699824,63cyclictest0-21swapper/223:18:532
2413699824,61cyclictest0-21swapper/221:00:512
2413699824,58cyclictest0-21swapper/221:10:442
2413699824,11cyclictest8643-21munin-node00:00:432
2413699824,11cyclictest0-21swapper/221:06:582
2413699823,12cyclictest0-21swapper/223:28:182
2413699823,12cyclictest0-21swapper/223:28:182
2413699823,12cyclictest0-21swapper/219:02:262
24136998212,52cyclictest0-21swapper/223:45:542
2413599825,70cyclictest0-21swapper/100:03:241
2413599824,71cyclictest27286-21runrttasks22:21:421
2413599824,70cyclictest5854-21sshd23:53:111
2413599824,70cyclictest0-21swapper/100:05:321
2413599823,73cyclictest2533-21munin-plugin-st20:25:281
2413599823,73cyclictest15579-21idleruntime-cro00:15:191
2413599823,73cyclictest15579-21idleruntime-cro00:15:191
24135998217,34cyclictest27597-21idleruntime21:15:501
2413699814,55cyclictest0-21swapper/221:40:482
2413699814,12cyclictest0-21swapper/222:20:512
2413699814,12cyclictest0-21swapper/200:05:452
2413699813,57cyclictest0-21swapper/220:40:392
2413699813,53cyclictest0-21swapper/222:40:502
2413699813,53cyclictest0-21swapper/222:40:502
24136998115,51cyclictest0-21swapper/221:45:372
2413599814,70cyclictest0-21swapper/122:50:541
2413599814,70cyclictest0-21swapper/119:25:571
2413599814,69cyclictest0-21swapper/123:55:501
2413599814,47cyclictest0-21swapper/122:55:591
2413599813,71cyclictest2329-21taskset23:45:451
2413599813,71cyclictest0-21swapper/123:00:351
2413599813,70cyclictest23882-21gltestperf22:15:431
2413599813,70cyclictest0-21swapper/119:20:451
2413599812,61cyclictest23045-21cat20:00:301
2413599812,61cyclictest23045-21cat20:00:301
2413699805,60cyclictest0-21swapper/219:12:392
2413699805,60cyclictest0-21swapper/219:12:392
24136998012,46cyclictest0-21swapper/222:30:352
2413599804,69cyclictest0-21swapper/100:20:451
2413599803,71cyclictest0-21swapper/120:10:491
2413599803,70cyclictest1369-21runrttasks23:29:571
2413599803,70cyclictest1369-21runrttasks23:29:571
2413599803,70cyclictest0-21swapper/122:00:351
2413599803,70cyclictest0-21swapper/122:00:351
2413599803,70cyclictest0-21swapper/118:58:551
2413699794,67cyclictest0-21swapper/222:35:522
2413699794,57cyclictest0-21swapper/221:15:412
2413699794,13cyclictest0-21swapper/223:23:532
2413699793,9cyclictest1618-21nscd19:00:312
2413599794,68cyclictest0-21swapper/122:45:361
2413599794,68cyclictest0-21swapper/121:53:481
2413599794,67cyclictest0-21swapper/123:35:321
24135997938,34cyclictest16260-21tr19:45:451
243799780,4rtkit-daemon2436-21rtkit-daemon19:19:031
2413699784,53cyclictest0-21swapper/219:57:462
2413699784,53cyclictest0-21swapper/219:57:462
2413699784,52cyclictest0-21swapper/219:17:402
2413699784,12cyclictest0-21swapper/223:30:432
2413699783,12cyclictest0-21swapper/220:50:382
2413599784,67cyclictest0-21swapper/121:35:401
2413599784,66cyclictest0-21swapper/123:45:081
2413599783,69cyclictest0-21swapper/122:40:361
2413599783,69cyclictest0-21swapper/122:40:361
2413599782,68cyclictest21856-21needreboot22:10:491
2413699774,14cyclictest0-21swapper/223:55:412
2413699774,13cyclictest0-21swapper/222:56:012
2413699774,13cyclictest0-21swapper/222:11:052
2413599775,66cyclictest1618-21nscd20:50:271
2413599774,66cyclictest0-21swapper/120:55:561
2413599773,8cyclictest23314-21sendmail_mailtr21:05:581
2413599773,68cyclictest32547-21cut22:35:241
2413599773,67cyclictest0-21swapper/119:50:591
2413599773,52cyclictest1243-21snmpd19:36:001
2413699764,55cyclictest0-21swapper/222:05:492
2413699764,13cyclictest0-21swapper/220:05:462
2413699764,12cyclictest0-21swapper/220:55:392
2413699763,59cyclictest0-21swapper/223:05:362
2413599764,65cyclictest2356-21gltestperf21:30:461
2413599764,65cyclictest0-21swapper/120:08:521
2413599764,64cyclictest0-21swapper/123:05:541
2413599764,54cyclictest23103-21munin-node20:00:541
2413599763,65cyclictest0-21swapper/120:38:551
2413599763,65cyclictest0-21swapper/120:38:551
2413699753,57cyclictest4005-21munin-node19:21:032
2413699753,54cyclictest0-21swapper/220:25:392
2413599753,66cyclictest0-21swapper/120:15:581
2413599753,48cyclictest0-21swapper/120:50:561
243799740,4rtkit-daemon2436-21rtkit-daemon19:25:550
2413699746,52cyclictest6206-1kworker/2:1H21:55:522
2413599744,58cyclictest0-21swapper/123:30:351
2413599743,65cyclictest0-21swapper/121:10:581
2413599743,65cyclictest0-21swapper/120:28:291
2413599743,65cyclictest0-21swapper/100:18:261
2413599743,44cyclictest0-21swapper/119:30:491
2413699734,12cyclictest0-21swapper/223:35:352
2413699734,12cyclictest0-21swapper/219:25:422
2413599733,64cyclictest5279-21sh20:30:411
2413599733,64cyclictest0-21swapper/121:45:261
2413599733,45cyclictest0-21swapper/121:28:571
2413599724,60cyclictest0-21swapper/119:43:321
2413599723,61cyclictest0-21swapper/119:00:351
2413599713,62cyclictest0-21swapper/119:10:561
2413599713,62cyclictest0-21swapper/119:10:561
2413599713,61cyclictest0-21swapper/122:08:361
2413599704,7cyclictest19411-21cut23:15:321
2413599703,61cyclictest30146-21sh19:05:531
2413599703,61cyclictest0-21swapper/122:35:391
2413599703,61cyclictest0-21swapper/121:57:411
2413599703,61cyclictest0-21swapper/121:00:381
2413599703,39cyclictest0-21swapper/121:24:071
2413599703,39cyclictest0-21swapper/121:24:071
243799680,4rtkit-daemon2436-21rtkit-daemon19:19:260
242762650,7sleep30-21swapper/320:00:553
2413799644,52cyclictest0-21swapper/322:05:573
24135996412,45cyclictest0-21swapper/118:55:321
2413799634,50cyclictest0-21swapper/323:05:223
24131996240,15cyclictest0-21swapper/000:18:170
2413199624,49cyclictest0-21swapper/022:45:440
2413199624,36cyclictest0-21swapper/023:35:210
24131996139,15cyclictest0-21swapper/023:45:500
24137996040,12cyclictest6792-21grep22:45:583
24137996037,14cyclictest29793-21grep21:20:483
24137996037,14cyclictest29793-21grep21:20:483
24131996043,9cyclictest148072sleep021:55:560
24131996039,14cyclictest0-21swapper/022:40:470
24131996039,14cyclictest0-21swapper/022:40:470
228862608,41sleep00-21swapper/018:50:520
2413199584,46cyclictest0-21swapper/023:25:510
2413199584,46cyclictest0-21swapper/023:25:510
264552573,11sleep00-21swapper/018:59:580
2413799575,14cyclictest0-21swapper/323:38:203
24131995738,13cyclictest0-21swapper/020:49:500
10102573,46sleep00-21swapper/019:12:430
10102573,46sleep00-21swapper/019:12:430
2413799564,33cyclictest0-21swapper/320:05:563
202002562,11sleep00-21swapper/019:51:540
195872564,9sleep319612-21ntp_states19:50:563
119662563,46sleep00-21swapper/022:59:460
107892562,46sleep00-21swapper/000:05:200
299162552,11sleep00-21swapper/022:29:510
284672554,44sleep30-21swapper/320:10:473
245702554,44sleep00-21swapper/022:15:560
2413799555,30cyclictest0-21swapper/321:45:383
24137995515,25cyclictest0-21swapper/322:56:013
24131995535,12cyclictest27572-21tail19:00:490
2413199553,46cyclictest0-21swapper/021:30:390
234512553,7sleep323581-21sed22:15:393
178602552,12sleep00-21swapper/022:03:230
178602552,12sleep00-21swapper/022:03:230
83402542,12sleep00-21swapper/021:43:560
31942542,44sleep00-21swapper/020:25:440
310862542,12sleep00-21swapper/023:39:570
297792542,13sleep00-21swapper/020:12:090
291222542,11sleep00-21swapper/019:05:380
2413799544,8cyclictest18786-21uniq00:20:383
24137995421,14cyclictest0-21swapper/322:50:463
16722543,10sleep31774-21df23:45:403
117702542,13sleep00-21swapper/020:41:360
285512532,11sleep00-21swapper/021:17:070
244012533,42sleep024517-21cpuspeed21:10:380
2413199535,41cyclictest0-21swapper/022:20:360
2413199534,41cyclictest0-21swapper/023:40:500
238972533,44sleep00-21swapper/021:08:450
214902533,42sleep00-21swapper/023:19:330
326522522,44sleep00-21swapper/020:20:320
243799520,4rtkit-daemon2436-21rtkit-daemon21:23:280
243799520,4rtkit-daemon2436-21rtkit-daemon21:23:280
2413799525,40cyclictest0-21swapper/323:05:503
2413799525,26cyclictest0-21swapper/321:00:403
2413799524,40cyclictest0-21swapper/320:56:023
2413799524,40cyclictest0-21swapper/300:15:453
2413799524,29cyclictest0-21swapper/323:33:193
2413799524,11cyclictest0-21swapper/321:15:453
2413799523,28cyclictest0-21swapper/322:00:453
2413799523,28cyclictest0-21swapper/322:00:453
24137995221,12cyclictest18468-21smartctl23:10:533
2413199525,30cyclictest0-21swapper/023:05:540
2413199523,42cyclictest0-21swapper/022:30:400
225472522,10sleep00-21swapper/022:12:170
22222522,11sleep00-21swapper/022:38:010
202032522,44sleep00-21swapper/000:23:420
201102523,44sleep00-21swapper/022:06:370
178272522,12sleep00-21swapper/019:47:060
165702522,11sleep00-21swapper/020:51:440
155692523,11sleep00-21swapper/019:44:000
83672512,14sleep00-21swapper/023:59:520
52892513,42sleep05320-21python23:50:530
25362513,7sleep32558-21iostat_ios21:30:493
2413799514,27cyclictest0-21swapper/320:17:493
2413799514,25cyclictest0-21swapper/320:20:343
24137995133,11cyclictest14319-21grep21:55:473
24137995121,15cyclictest0-21swapper/320:45:533
24137995121,14cyclictest0-21swapper/319:26:003
24137995119,13cyclictest0-21swapper/321:36:013
24137995119,13cyclictest0-21swapper/321:07:563
24137995118,13cyclictest0-21swapper/322:33:103
2413199515,28cyclictest0-21swapper/022:50:470
2413199514,29cyclictest0-21swapper/020:15:480
24131995130,14cyclictest0-21swapper/021:05:270
2413199513,43cyclictest0-21swapper/019:21:050
2413199513,41cyclictest0-21swapper/020:06:000
83102503,10sleep30-21swapper/323:59:063
2413799505,30cyclictest0-21swapper/320:30:503
2413799505,29cyclictest0-21swapper/323:20:543
2413799505,26cyclictest0-21swapper/321:43:023
2413799504,30cyclictest0-21swapper/320:50:473
2413799504,29cyclictest0-21swapper/322:35:443
2413799504,26cyclictest0-21swapper/321:26:033
24137995032,11cyclictest31420-21tail23:40:323
24137995022,13cyclictest0-21swapper/322:45:233
24137995022,13cyclictest0-21swapper/322:45:233
2413799502,44cyclictest0-21swapper/319:01:453
24137995018,13cyclictest0-21swapper/319:47:453
24137995010,25cyclictest0-21swapper/319:40:413
2413199505,27cyclictest0-21swapper/019:35:300
2413199504,29cyclictest0-21swapper/023:00:520
24131995034,11cyclictest0-21swapper/020:00:490
108412502,9sleep30-21swapper/319:34:313
106772503,8sleep01243-21snmpd21:48:030
10662504,39sleep30-21swapper/319:13:233
10662504,39sleep30-21swapper/319:13:233
8592492,12sleep00-21swapper/021:26:590
34212494,38sleep30-21swapper/320:25:473
2413799495,28cyclictest0-21swapper/321:10:533
2413799495,26cyclictest0-21swapper/319:37:433
2413799495,26cyclictest0-21swapper/300:08:243
2413799495,25cyclictest0-21swapper/300:10:503
2413799495,25cyclictest0-21swapper/300:10:503
2413799495,25cyclictest0-21swapper/300:01:513
2413799494,29cyclictest0-21swapper/322:20:393
2413799494,29cyclictest0-21swapper/320:35:553
2413799494,29cyclictest0-21swapper/320:35:553
2413799494,29cyclictest0-21swapper/319:05:443
2413799494,27cyclictest0-21swapper/323:18:163
24137994931,11cyclictest4797-21cut19:20:513
2413799493,27cyclictest0-21swapper/319:55:513
2413799493,27cyclictest0-21swapper/319:55:513
24137994917,11cyclictest0-21swapper/322:13:353
2413199495,36cyclictest0-21swapper/023:10:330
2413199494,28cyclictest0-21swapper/023:20:390
191792493,41sleep00-21swapper/020:59:300
131042492,11sleep00-21swapper/019:37:550
129142492,15sleep00-21swapper/000:06:570
263812482,40sleep30-21swapper/318:59:003
2413799484,21cyclictest0-21swapper/323:50:343
24137994831,11cyclictest2388-21gltestperf19:15:513
2413799483,8cyclictest34-21rcuc/321:50:573
2413799483,29cyclictest0-21swapper/320:40:563
24137994827,13cyclictest1369-21runrttasks23:25:453
24137994827,13cyclictest1369-21runrttasks23:25:453
24131994832,11cyclictest15130-21unixbench_multi00:10:530
24131994832,11cyclictest15130-21unixbench_multi00:10:530
2413199483,39cyclictest0-21swapper/020:00:280
2413199483,39cyclictest0-21swapper/020:00:280
24131994826,11cyclictest0-21swapper/021:50:550
2413199475,34cyclictest0-21swapper/020:40:290
2413199475,14cyclictest0-21swapper/020:30:440
240912474,6sleep30-21swapper/318:55:253
2413799464,27cyclictest0-21swapper/322:28:093
2413199464,16cyclictest0-21swapper/021:35:410
2413199463,38cyclictest0-21swapper/020:35:460
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional