You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 01:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun May 04, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
208702760,6sleep220872-21grep07:50:052
61972623,52sleep20-21swapper/206:10:232
877995916,27cyclictest0-21swapper/106:40:141
880995838,15cyclictest0-21swapper/309:37:003
224822583,48sleep30-21swapper/305:39:533
876995739,11cyclictest12525-21grep05:15:280
876995720,23cyclictest23860-21munin-node06:50:210
876995720,13cyclictest0-21swapper/008:10:500
34242573,46sleep30-21swapper/304:59:543
87899565,44cyclictest0-21swapper/206:15:252
87899564,45cyclictest0-21swapper/208:35:162
876995524,13cyclictest0-21swapper/009:14:430
315952553,11sleep10-21swapper/108:10:411
227799550,6rtkit-daemon2276-21rtkit-daemon05:10:153
877995423,13cyclictest0-21swapper/106:10:111
877995420,20cyclictest21532-21uname05:35:201
87699549,27cyclictest0-21swapper/008:24:460
87699545,33cyclictest0-21swapper/008:05:060
87699545,33cyclictest0-21swapper/008:05:060
876995410,27cyclictest0-21swapper/010:14:540
880995338,9cyclictest11421-21gltestperf09:45:063
878995335,11cyclictest9171-21crond08:34:452
87799535,26cyclictest0-21swapper/109:09:571
87799534,25cyclictest0-21swapper/105:46:051
87699534,41cyclictest0-21swapper/008:59:570
876995338,9cyclictest11754-21strings09:45:110
876995337,10cyclictest7675-21sort08:30:040
876995336,10cyclictest2177-21head09:25:090
876995336,10cyclictest2177-21head09:25:090
227799530,5rtkit-daemon2276-21rtkit-daemon09:10:433
227799530,5rtkit-daemon2276-21rtkit-daemon05:06:383
227799530,5rtkit-daemon2276-21rtkit-daemon05:06:383
880995236,10cyclictest17908-21cut06:35:173
880995236,10cyclictest17908-21cut06:35:173
87899524,30cyclictest0-21swapper/206:44:502
878995216,31cyclictest0-21swapper/205:10:032
87799525,29cyclictest0-21swapper/108:30:131
877995218,14cyclictest0-21swapper/110:10:371
877995218,14cyclictest0-21swapper/110:10:371
87699527,27cyclictest0-21swapper/007:54:590
87699524,30cyclictest0-21swapper/010:00:130
87699524,30cyclictest0-21swapper/005:09:530
87699524,30cyclictest0-21swapper/005:09:530
87699524,26cyclictest0-21swapper/008:39:580
876995235,10cyclictest20900-21grep10:05:030
876995235,10cyclictest2052-21grep04:55:150
876995235,10cyclictest17054-21tr06:35:050
876995235,10cyclictest17054-21tr06:35:050
876995234,11cyclictest25298-21cpuspeed_turbos08:00:020
876995234,11cyclictest25298-21cpuspeed_turbos08:00:020
876995221,13cyclictest0-21swapper/009:34:550
227799520,5rtkit-daemon2276-21rtkit-daemon06:10:583
153242523,42sleep315367-21date05:24:533
128142522,42sleep20-21swapper/207:34:472
109972520,4sleep311001-21cpuspeed_turbos07:30:033
94822513,7sleep19563-21aten_r1power_vo08:34:591
87799515,28cyclictest0-21swapper/107:35:051
87799514,29cyclictest0-21swapper/106:15:151
877995118,8cyclictest16389-21idleruntime07:40:131
87699518,27cyclictest31555-21tune2fs09:20:020
87699515,28cyclictest0-21swapper/009:55:140
87699514,32cyclictest1263-21runrttasks10:19:540
876995132,11cyclictest1789-21tune2fs07:10:070
87699512,43cyclictest0-21swapper/006:15:040
314932512,43sleep131603-21diskstats07:05:071
281502513,10sleep00-21swapper/006:56:360
234242512,9sleep30-21swapper/306:47:163
227799510,5rtkit-daemon2276-21rtkit-daemon08:54:593
227799510,5rtkit-daemon2276-21rtkit-daemon07:22:172
227799510,5rtkit-daemon2276-21rtkit-daemon07:22:172
227799510,5rtkit-daemon2276-21rtkit-daemon06:00:503
210512512,9sleep30-21swapper/306:42:403
178202512,9sleep30-21swapper/307:44:553
172582512,9sleep30-21swapper/307:40:323
87799506,27cyclictest0-21swapper/107:49:471
87799505,28cyclictest0-21swapper/106:55:101
87799505,27cyclictest0-21swapper/110:20:051
87799504,29cyclictest0-21swapper/106:05:051
87799504,28cyclictest0-21swapper/105:55:201
87799504,28cyclictest0-21swapper/105:55:201
87799504,27cyclictest0-21swapper/109:20:071
87799504,27cyclictest0-21swapper/106:25:031
87699507,27cyclictest0-21swapper/009:34:440
87699507,26cyclictest0-21swapper/008:55:010
87699505,28cyclictest0-21swapper/007:45:050
87699505,28cyclictest0-21swapper/007:35:240
87699505,28cyclictest0-21swapper/006:05:220
87699505,27cyclictest0-21swapper/009:15:150
87699505,27cyclictest0-21swapper/007:25:090
87699504,37cyclictest0-21swapper/006:14:500
87699504,28cyclictest0-21swapper/009:50:180
87699504,28cyclictest0-21swapper/007:30:060
87699504,27cyclictest0-21swapper/006:00:010
876995032,11cyclictest9289-21gltestperf05:10:150
876995020,13cyclictest0-21swapper/005:40:140
876995020,12cyclictest0-21swapper/008:24:580
876995013,11cyclictest0-21swapper/008:53:480
43722504,39sleep34461-21gltestperf05:00:153
317322502,9sleep20-21swapper/208:12:272
227799500,4rtkit-daemon2276-21rtkit-daemon08:54:143
227799500,4rtkit-daemon2276-21rtkit-daemon05:58:213
227799500,4rtkit-daemon2276-21rtkit-daemon05:58:213
223312502,9sleep20-21swapper/205:37:582
195752502,9sleep20-21swapper/210:01:052
92552492,9sleep30-21swapper/306:19:183
880994922,21cyclictest17574-21sshd05:28:053
878994934,9cyclictest28238-21gltestperf08:05:062
878994934,9cyclictest28238-21gltestperf08:05:062
878994933,10cyclictest25921-21wc08:00:082
878994933,10cyclictest25921-21wc08:00:082
878994933,10cyclictest24017-21aten2.4-expect06:50:032
878994930,14cyclictest0-21swapper/208:50:042
87799495,37cyclictest0-21swapper/107:00:111
87799494,28cyclictest0-21swapper/109:29:551
87799494,28cyclictest0-21swapper/108:50:121
87799494,28cyclictest0-21swapper/107:50:081
87799494,28cyclictest0-21swapper/107:24:491
87799494,28cyclictest0-21swapper/107:24:491
87799494,28cyclictest0-21swapper/105:40:271
87799494,28cyclictest0-21swapper/105:09:541
87799494,28cyclictest0-21swapper/105:09:541
87799494,27cyclictest0-21swapper/108:40:071
87799494,27cyclictest0-21swapper/108:05:131
87799494,27cyclictest0-21swapper/108:05:131
87799494,24cyclictest0-21swapper/108:14:571
87799494,22cyclictest0-21swapper/108:20:001
877994920,13cyclictest0-21swapper/107:55:081
877994920,12cyclictest0-21swapper/106:35:241
877994920,12cyclictest0-21swapper/106:35:241
877994920,12cyclictest0-21swapper/105:00:191
877994919,12cyclictest0-21swapper/105:30:071
87699495,26cyclictest0-21swapper/008:45:040
87699495,26cyclictest0-21swapper/008:45:040
87699494,37cyclictest13503-21cpuspeed_turbos05:20:090
87699494,28cyclictest0-21swapper/007:00:200
87699494,28cyclictest0-21swapper/005:55:260
87699494,28cyclictest0-21swapper/005:55:260
87699494,27cyclictest0-21swapper/008:35:180
87699494,27cyclictest0-21swapper/008:14:590
87699494,27cyclictest0-21swapper/007:44:480
876994929,14cyclictest0-21swapper/005:45:120
876994920,12cyclictest0-21swapper/005:25:310
87699492,39cyclictest31029-21munin-node07:05:170
876994919,15cyclictest1263-21runrttasks07:15:150
33862492,11sleep30-21swapper/309:29:553
323182493,39sleep232342-21python09:20:142
30742492,9sleep10-21swapper/104:55:371
305912492,9sleep30-21swapper/307:02:193
276652495,37sleep10-21swapper/105:50:061
276652495,37sleep10-21swapper/105:50:061
164092492,41sleep10-21swapper/106:34:201
150602492,9sleep20-21swapper/209:54:242
128872492,9sleep10-21swapper/105:19:111
126672492,41sleep10-21swapper/107:32:521
102062492,9sleep20-21swapper/209:43:322
880994832,8cyclictest24298-21sed06:50:053
880994820,8cyclictest5096-21sort07:15:233
878994833,9cyclictest27911-21tune2fs10:20:002
87799485,26cyclictest0-21swapper/107:18:321
87799484,27cyclictest0-21swapper/109:55:041
87799484,27cyclictest0-21swapper/109:49:561
87799484,27cyclictest0-21swapper/108:00:201
87799484,27cyclictest0-21swapper/108:00:201
87799484,27cyclictest0-21swapper/107:10:221
87799484,27cyclictest0-21swapper/106:45:141
87799484,27cyclictest0-21swapper/106:00:111
87799484,27cyclictest0-21swapper/105:25:271
87799484,27cyclictest0-21swapper/105:10:121
87799483,31cyclictest0-21swapper/109:26:281
87799483,31cyclictest0-21swapper/109:26:281
87699484,27cyclictest0-21swapper/007:50:050
87699484,27cyclictest0-21swapper/006:20:260
87699483,40cyclictest41ktimersoftd/006:45:090
876994818,13cyclictest0-21swapper/005:00:180
876994817,13cyclictest0-21swapper/010:09:580
876994817,13cyclictest0-21swapper/010:09:580
87699481,27cyclictest20338-21munin-node05:35:260
64612482,40sleep10-21swapper/108:25:281
258402483,9sleep00-21swapper/009:09:120
246012482,9sleep30-21swapper/305:41:303
227799480,5rtkit-daemon2276-21rtkit-daemon06:05:133
227799480,5rtkit-daemon2276-21rtkit-daemon05:50:213
227799480,5rtkit-daemon2276-21rtkit-daemon05:50:213
160082482,9sleep10-21swapper/108:45:351
160082482,9sleep10-21swapper/108:45:351
88099474,36cyclictest0-21swapper/305:30:173
880994732,10cyclictest20698-21cut10:05:013
880994730,11cyclictest29395-21crond10:24:413
88099472,40cyclictest0-21swapper/309:06:203
87899475,35cyclictest0-21swapper/207:49:472
87899474,36cyclictest6478-21tune2fs09:35:012
87899474,36cyclictest0-21swapper/209:09:442
878994731,11cyclictest9999-21unixbench_multi07:25:262
878994731,11cyclictest3468-21head08:20:122
878994731,10cyclictest12679-21grep06:25:102
87799474,26cyclictest0-21swapper/106:20:081
87799474,26cyclictest0-21swapper/104:54:541
877994729,11cyclictest8463-21cpuspeed_turbos09:39:571
877994721,13cyclictest0-21swapper/109:05:181
877994719,12cyclictest0-21swapper/109:03:581
877994718,13cyclictest0-21swapper/107:25:041
87699474,25cyclictest0-21swapper/006:30:400
876994733,9cyclictest9906-21grep09:40:170
77522473,9sleep00-21swapper/007:20:580
77522473,9sleep00-21swapper/007:20:580
40952472,10sleep20-21swapper/207:15:082
220032472,39sleep10-21swapper/110:06:361
195422472,9sleep10-21swapper/110:00:401
114882472,9sleep30-21swapper/306:22:213
88099463,36cyclictest0-21swapper/308:14:473
880994629,10cyclictest16212-21tail09:55:033
87899465,34cyclictest4540-21munin-run06:09:512
87899464,36cyclictest0-21swapper/209:04:442
878994633,8cyclictest5319-21unixbench-2d05:00:282
878994633,8cyclictest26624-21unixbench_singl10:15:162
878994632,9cyclictest28138-21fschecks_count05:50:102
878994632,9cyclictest28138-21fschecks_count05:50:102
878994632,8cyclictest18876-21wc05:30:172
878994631,10cyclictest6088-21aten_r1power_en05:05:072
878994631,10cyclictest6088-21aten_r1power_en05:05:072
878994629,10cyclictest18036-21ps06:35:192
878994629,10cyclictest18036-21ps06:35:192
878994626,15cyclictest0-21swapper/210:09:542
878994626,15cyclictest0-21swapper/210:09:542
87799464,26cyclictest0-21swapper/109:15:021
87799463,26cyclictest0-21swapper/105:20:311
877994618,12cyclictest0-21swapper/106:50:001
87699464,26cyclictest0-21swapper/006:40:060
87699464,16cyclictest0-21swapper/005:51:050
87699464,16cyclictest0-21swapper/005:51:050
62632462,9sleep20-21swapper/208:25:212
30812462,9sleep20-21swapper/207:12:142
260132463,37sleep326020-21munin-node08:00:113
260132463,37sleep326020-21munin-node08:00:113
196532462,9sleep30-21swapper/310:02:073
113882462,38sleep20-21swapper/206:21:032
880994516,9cyclictest21439-21aten_r1power_fr08:59:573
878994530,9cyclictest24384-21grep07:55:212
878994530,9cyclictest13242-21aten_r1power_en05:20:072
878994530,10cyclictest14464-21aten2.4-expect06:30:042
878994512,27cyclictest11252-21grep09:45:042
878994510,9cyclictest1632-21nscd06:04:512
87799454,33cyclictest0-21swapper/108:55:111
76912452,37sleep10-21swapper/109:36:461
54642452,36sleep20-21swapper/209:33:532
31102452,9sleep20-21swapper/204:56:072
308902452,9sleep30-21swapper/309:19:553
303472452,36sleep30-21swapper/309:15:443
281952452,9sleep30-21swapper/306:57:113
270742452,9sleep20-21swapper/205:47:252
88099443,36cyclictest0-21swapper/310:15:543
88099443,36cyclictest0-21swapper/308:45:093
88099443,36cyclictest0-21swapper/308:45:093
880994418,20cyclictest3155-21latency_hist09:29:443
880994418,20cyclictest3155-21latency_hist09:29:443
880994416,22cyclictest13514-21df09:50:003
87899445,33cyclictest0-21swapper/207:40:262
87899443,36cyclictest0-21swapper/206:55:182
878994429,10cyclictest2364-21metacity05:59:502
878994429,10cyclictest2364-21metacity05:59:502
87899442,38cyclictest0-21swapper/209:10:392
87899442,11cyclictest0-21swapper/208:47:242
87899442,11cyclictest0-21swapper/208:47:242
87699445,22cyclictest4516-1kworker/0:1H06:25:080
64582442,9sleep30-21swapper/308:25:263
268152442,9sleep10-21swapper/110:17:081
246622442,9sleep20-21swapper/205:42:172
228752443,8sleep222906-21python06:45:212
101302442,9sleep30-21swapper/309:42:323
88099433,10cyclictest10285-21head08:35:063
880994326,11cyclictest27685-21cpuspeed_turbos08:05:013
880994326,11cyclictest27685-21cpuspeed_turbos08:05:013
880994324,12cyclictest0-21swapper/308:30:053
880994312,26cyclictest0-21swapper/305:15:263
87899434,33cyclictest0-21swapper/208:18:302
87899434,33cyclictest0-21swapper/207:35:042
87899434,33cyclictest0-21swapper/207:00:022
87899434,14cyclictest0-21swapper/205:15:062
87899433,35cyclictest0-21swapper/210:05:172
87899432,37cyclictest0-21swapper/209:25:012
87899432,37cyclictest0-21swapper/209:25:012
87899432,35cyclictest0-21swapper/209:54:562
877994318,10cyclictest10572-21telnet09:44:581
306192433,34sleep20-21swapper/209:19:182
148952432,9sleep30-21swapper/307:35:483
117972432,33sleep30-21swapper/308:39:573
88099423,34cyclictest0-21swapper/307:20:193
88099423,34cyclictest0-21swapper/307:20:193
88099423,33cyclictest0-21swapper/310:09:543
88099423,33cyclictest0-21swapper/310:09:543
880994226,10cyclictest14624-21tr06:30:063
88099422,34cyclictest0-21swapper/305:45:113
88099422,24cyclictest0-21swapper/307:56:593
87899425,31cyclictest0-21swapper/205:25:062
87899424,32cyclictest0-21swapper/204:54:542
87899422,35cyclictest0-21swapper/208:55:002
87699424,13cyclictest0-21swapper/005:30:130
4002422,34sleep30-21swapper/307:05:503
220492422,33sleep30-21swapper/307:50:353
16982422,9sleep30-21swapper/308:17:073
103452422,9sleep30-21swapper/307:28:433
88099413,31cyclictest0-21swapper/306:25:033
87899413,33cyclictest0-21swapper/208:40:132
7682415,30sleep00-21swapper/004:54:030
31222412,31sleep30-21swapper/307:12:473
88099403,9cyclictest2239-21cut08:19:583
878994012,22cyclictest31853-21gltestperf07:05:102
880993919,14cyclictest0-21swapper/304:54:543
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional