You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 03:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot7s.osadl.org (updated Tue May 13, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313895212868,22sleep20-21swapper/219:08:582
313627211660,25sleep00-21swapper/019:05:320
313881210274,20sleep30-21swapper/319:08:473
313695210272,22sleep10-21swapper/119:06:241
3656922760,0sleep00-21swapper/021:16:400
314111995713,43cyclictest0-21swapper/221:25:262
31411499286,7cyclictest361013-21wc21:05:173
31411199250,25cyclictest0-21swapper/220:27:432
31411199240,16cyclictest0-21swapper/222:54:142
314108992413,10cyclictest0-21swapper/121:45:331
314108992312,10cyclictest0-21swapper/120:11:251
31410699231,14cyclictest0-21swapper/022:09:390
314108992211,10cyclictest0-21swapper/123:20:271
314111992112,9cyclictest0-21swapper/200:10:172
314108992112,4cyclictest0-21swapper/122:40:381
31411499207,13cyclictest0-21swapper/300:10:153
314114992010,10cyclictest0-21swapper/320:19:553
31410899199,4cyclictest0-21swapper/123:43:161
31410899199,4cyclictest0-21swapper/121:14:531
31410899198,10cyclictest0-21swapper/122:00:401
314106991914,5cyclictest0-21swapper/019:51:270
31411499188,10cyclictest0-21swapper/320:53:503
314111991815,2cyclictest1051-21snmpd23:49:542
314111991815,2cyclictest1051-21snmpd00:25:532
314108991818,0cyclictest0-21swapper/121:43:201
314108991816,1cyclictest0-21swapper/122:37:201
31410899180,17cyclictest0-21swapper/120:36:071
31410899180,17cyclictest0-21swapper/100:13:581
31410699189,9cyclictest0-21swapper/023:10:200
314106991816,1cyclictest0-21swapper/022:45:460
31410699180,17cyclictest0-21swapper/000:27:050
31411499170,1cyclictest0-21swapper/323:50:183
31411199170,17cyclictest0-21swapper/219:17:182
31410899177,4cyclictest0-21swapper/119:57:581
31410899177,4cyclictest0-21swapper/100:31:351
31410899170,3cyclictest0-21swapper/120:26:251
31410899170,17cyclictest0-21swapper/119:42:091
31410899170,16cyclictest0-21swapper/122:47:201
31410899170,16cyclictest0-21swapper/120:30:551
314106991712,5cyclictest0-21swapper/021:30:000
31410699170,17cyclictest0-21swapper/023:48:090
31410699170,17cyclictest0-21swapper/023:27:410
31410699170,17cyclictest0-21swapper/021:46:540
31410699170,17cyclictest0-21swapper/000:18:190
31410699170,16cyclictest0-21swapper/022:35:400
31410699170,16cyclictest0-21swapper/019:26:240
31411499166,10cyclictest0-21swapper/321:03:323
314114991614,1cyclictest1051-21snmpd22:35:263
314114991614,1cyclictest1051-21snmpd19:45:513
314114991614,1cyclictest1045-21nmbd22:51:213
314114991612,4cyclictest0-21swapper/319:27:243
314114991611,5cyclictest0-21swapper/300:15:053
31411499160,7cyclictest0-21swapper/322:04:513
31411499160,15cyclictest0-21swapper/323:40:133
31411499160,11cyclictest0-21swapper/322:56:553
314111991611,5cyclictest0-21swapper/200:35:182
31411199160,7cyclictest0-21swapper/200:19:282
31411199160,16cyclictest0-21swapper/223:50:282
31411199160,16cyclictest0-21swapper/220:53:442
31411199160,16cyclictest0-21swapper/220:33:132
31410899165,1cyclictest0-21swapper/100:01:551
31410899160,7cyclictest0-21swapper/122:06:091
31410899160,7cyclictest0-21swapper/121:56:451
31410899160,7cyclictest0-21swapper/121:00:291
31410899160,16cyclictest0-21swapper/100:28:111
31410699166,5cyclictest347301-21ntpq20:30:190
314106991613,2cyclictest1051-21snmpd20:56:410
314106991613,2cyclictest1051-21snmpd19:44:010
31410699160,8cyclictest0-21swapper/020:01:340
31410699160,7cyclictest0-21swapper/021:56:410
31410699160,16cyclictest0-21swapper/022:15:220
31410699160,16cyclictest0-21swapper/021:26:170
31410699160,15cyclictest0-21swapper/000:11:190
31411499154,10cyclictest3380932sleep320:07:223
314114991511,4cyclictest0-21swapper/322:08:123
31411499150,1cyclictest0-21swapper/319:15:203
31411499150,15cyclictest0-21swapper/322:15:243
31411199156,9cyclictest0-21swapper/220:13:142
314111991511,4cyclictest0-21swapper/222:49:162
31411199150,6cyclictest0-21swapper/219:43:032
31411199150,6cyclictest0-21swapper/219:32:422
31411199150,1cyclictest0-21swapper/219:10:172
31411199150,1cyclictest0-21swapper/219:10:162
31411199150,15cyclictest0-21swapper/222:02:072
31411199150,15cyclictest0-21swapper/220:20:162
31411199150,15cyclictest0-21swapper/220:00:102
31411199150,15cyclictest0-21swapper/200:32:542
314108991511,4cyclictest0-21swapper/121:50:421
314108991510,1cyclictest0-21swapper/122:50:501
31410899150,6cyclictest0-21swapper/123:38:031
31410899150,6cyclictest0-21swapper/122:12:521
31410899150,6cyclictest0-21swapper/121:19:231
31410899150,6cyclictest0-21swapper/119:48:301
31410899150,6cyclictest0-21swapper/119:33:241
31410899150,6cyclictest0-21swapper/119:22:271
31410899150,15cyclictest0-21swapper/123:48:121
31410699156,4cyclictest372427-21df_inode21:35:150
314106991513,1cyclictest0-21swapper/022:50:140
314106991511,4cyclictest0-21swapper/020:27:190
314106991510,4cyclictest0-21swapper/022:58:380
31410699150,6cyclictest0-21swapper/022:29:280
31410699150,13cyclictest0-21swapper/021:00:130
31411499144,10cyclictest0-21swapper/323:12:593
31411499144,10cyclictest0-21swapper/321:30:363
314114991413,1cyclictest50-21ksoftirqd/321:20:413
31411499141,13cyclictest0-21swapper/320:55:163
314114991410,4cyclictest0-21swapper/322:11:493
314114991410,4cyclictest0-21swapper/321:14:103
314114991410,4cyclictest0-21swapper/320:32:153
314114991410,4cyclictest0-21swapper/319:50:313
31411499140,1cyclictest0-21swapper/323:30:183
31411499140,1cyclictest0-21swapper/323:30:173
31411199144,1cyclictest0-21swapper/220:56:022
31411199144,10cyclictest0-21swapper/222:22:462
314111991410,4cyclictest0-21swapper/219:58:492
31411199140,1cyclictest0-21swapper/223:55:132
31410899144,10cyclictest0-21swapper/122:58:111
314108991412,1cyclictest0-21swapper/119:11:351
314108991412,1cyclictest0-21swapper/119:11:351
314108991411,3cyclictest0-21swapper/121:32:481
31410899140,13cyclictest0-21swapper/123:50:121
31410699149,4cyclictest0-21swapper/023:07:210
31410699149,4cyclictest0-21swapper/019:46:180
31410699144,4cyclictest0-21swapper/022:41:350
31410699144,10cyclictest0-21swapper/020:09:100
314106991411,2cyclictest872-21abrt-dump-journ23:34:590
314106991410,4cyclictest0-21swapper/022:04:220
314106991410,4cyclictest0-21swapper/019:37:480
31410699140,6cyclictest0-21swapper/021:52:090
31410699140,1cyclictest0-21swapper/022:30:190
31410699140,13cyclictest0-21swapper/023:55:150
31411499139,4cyclictest0-21swapper/319:56:513
31411499138,5cyclictest0-21swapper/323:00:083
31411499134,9cyclictest0-21swapper/321:25:103
31411499133,10cyclictest0-21swapper/320:41:353
314114991310,2cyclictest1051-21snmpd21:15:143
31411499130,13cyclictest0-21swapper/320:20:143
31411499130,13cyclictest0-21swapper/300:25:213
31411199139,4cyclictest0-21swapper/223:20:392
31411199139,4cyclictest0-21swapper/221:51:052
31411199139,4cyclictest0-21swapper/219:47:422
31411199132,11cyclictest0-21swapper/220:05:252
314111991312,1cyclictest1051-21snmpd22:34:252
314111991312,1cyclictest0-21swapper/221:30:222
314111991312,1cyclictest0-21swapper/220:45:212
31411199130,13cyclictest0-21swapper/223:00:262
31411199130,13cyclictest0-21swapper/222:05:212
31411199130,13cyclictest0-21swapper/219:25:132
31410899133,9cyclictest0-21swapper/122:27:161
31410899133,10cyclictest0-21swapper/120:50:531
31410899133,10cyclictest0-21swapper/120:22:311
31410899132,1cyclictest0-21swapper/123:19:481
31410899132,10cyclictest0-21swapper/122:16:341
314108991312,1cyclictest0-21swapper/123:34:101
314108991312,1cyclictest0-21swapper/123:34:091
314108991310,2cyclictest1051-21snmpd20:07:431
314108991310,2cyclictest1051-21snmpd00:23:201
31410899130,13cyclictest0-21swapper/123:05:511
31410899130,13cyclictest0-21swapper/119:25:191
31410699133,9cyclictest0-21swapper/023:00:190
31410699132,1cyclictest0-21swapper/023:32:130
31410699132,1cyclictest0-21swapper/023:32:130
314106991312,1cyclictest0-21swapper/000:20:160
314106991310,2cyclictest1051-21snmpd21:14:350
314106991310,2cyclictest1051-21snmpd00:05:400
314106991310,2cyclictest1051-21snmpd00:04:550
31410699130,1cyclictest0-21swapper/000:30:210
31411499129,2cyclictest1051-21snmpd23:17:243
31411499129,2cyclictest1051-21snmpd23:09:003
31411499129,2cyclictest1051-21snmpd22:24:343
31411499129,2cyclictest1051-21snmpd19:30:573
31411499123,9cyclictest0-21swapper/322:32:093
31411499122,10cyclictest50-21ksoftirqd/323:24:443
31411499122,10cyclictest0-21swapper/321:38:273
31411499122,10cyclictest0-21swapper/320:11:433
31411199129,2cyclictest1051-21snmpd23:06:392
31411199129,2cyclictest1051-21snmpd22:25:462
31411199129,2cyclictest1051-21snmpd22:10:042
31411199129,2cyclictest1051-21snmpd21:41:482
31411199129,2cyclictest1051-21snmpd19:35:122
31411199120,1cyclictest0-21swapper/221:20:192
31410899129,2cyclictest1051-21snmpd22:31:511
31410899129,2cyclictest1051-21snmpd22:20:421
31410899129,2cyclictest1051-21snmpd21:38:481
31410899129,2cyclictest1051-21snmpd20:40:161
31410899129,2cyclictest1051-21snmpd19:36:151
31410899125,7cyclictest0-21swapper/120:47:591
31410899122,9cyclictest0-21swapper/120:55:051
314108991211,1cyclictest0-21swapper/123:29:481
31410699129,2cyclictest1051-21snmpd20:47:410
31410699129,2cyclictest1051-21snmpd19:17:090
314106991211,1cyclictest0-21swapper/020:20:150
314106991210,2cyclictest1051-21snmpd21:22:110
3484142110,1sleep016-21ksoftirqd/020:35:140
31411499119,1cyclictest796-21systemd-logind20:39:593
31411499119,1cyclictest1051-21snmpd21:48:573
31411499119,1cyclictest1051-21snmpd20:27:043
31411499118,2cyclictest1051-21snmpd23:46:273
31411499118,2cyclictest1051-21snmpd23:37:303
314114991110,1cyclictest1051-21snmpd22:45:373
314114991110,1cyclictest0-21swapper/321:53:563
314114991110,1cyclictest0-21swapper/319:35:193
31411199119,2cyclictest1051-21snmpd23:11:142
31411199119,1cyclictest796-21systemd-logind23:39:592
31411199119,1cyclictest1051-21snmpd22:36:472
31411199119,1cyclictest0-21swapper/223:30:162
31411199119,1cyclictest0-21swapper/223:30:152
31411199118,2cyclictest1051-21snmpd20:15:132
31411199118,2cyclictest1051-21snmpd00:21:592
31411199117,4cyclictest876-21NetworkManager22:15:292
31411199117,4cyclictest876-21NetworkManager21:09:042
31411199116,5cyclictest876-21NetworkManager21:55:172
31411199110,7cyclictest191rcu_preempt23:25:152
31411199110,1cyclictest0-21swapper/220:35:202
31410899119,1cyclictest1051-21snmpd21:06:261
31410899118,2cyclictest410239-21awk23:10:171
31410899118,2cyclictest1051-21snmpd23:56:471
31410899118,2cyclictest1051-21snmpd21:25:131
31410899118,2cyclictest1051-21snmpd20:17:071
31410899116,5cyclictest0-21swapper/119:16:081
31410899115,6cyclictest0-21swapper/121:22:411
314108991110,1cyclictest798-21systemd-machine19:54:591
31410899110,10cyclictest0-21swapper/100:05:321
31410699119,1cyclictest1051-21snmpd23:50:210
31410699119,1cyclictest1051-21snmpd23:44:190
31410699119,1cyclictest1051-21snmpd23:21:030
31410699119,1cyclictest1051-21snmpd21:08:590
31410699117,4cyclictest0-21swapper/022:13:190
31410699116,5cyclictest0-21swapper/019:14:230
31410699116,5cyclictest0-21swapper/019:14:230
31411499109,1cyclictest0-21swapper/319:41:273
31411499109,1cyclictest0-21swapper/300:35:263
31411499108,2cyclictest335696-21threads20:00:213
31411499107,2cyclictest1051-21snmpd23:59:553
31411499107,2cyclictest1051-21snmpd22:40:443
31411499106,4cyclictest0-21swapper/319:20:303
31411499100,4cyclictest0-21swapper/320:46:173
31411499100,10cyclictest0-21swapper/323:25:083
31411499100,10cyclictest0-21swapper/300:21:313
31411499100,10cyclictest0-21swapper/300:01:253
31411199107,2cyclictest399563-21sed22:45:002
31411199106,4cyclictest876-21NetworkManager23:43:122
31411199106,4cyclictest876-21NetworkManager21:01:582
31411199106,4cyclictest876-21NetworkManager00:01:442
31411199103,7cyclictest0-21swapper/219:50:152
31411199100,10cyclictest0-21swapper/221:38:152
31411199100,10cyclictest0-21swapper/221:14:022
31411199100,10cyclictest0-21swapper/220:41:532
31411199100,10cyclictest0-21swapper/219:20:422
31411199100,10cyclictest0-21swapper/200:05:592
31410899109,1cyclictest0-21swapper/123:03:561
31410899108,1cyclictest1051-21snmpd20:00:401
31410899107,2cyclictest1051-21snmpd00:36:471
31410899100,10cyclictest0-21swapper/100:16:551
31410699108,1cyclictest1051-21snmpd20:11:040
31410699107,2cyclictest1051-21snmpd20:17:370
31410699107,2cyclictest1051-21snmpd00:35:240
31410699106,4cyclictest0-21swapper/023:15:500
31410699100,10cyclictest0-21swapper/022:20:510
31410699100,10cyclictest0-21swapper/019:32:000
3141149998,1cyclictest1051-21snmpd19:11:273
3141149998,1cyclictest1051-21snmpd19:11:263
3141149998,1cyclictest1051-21snmpd00:30:363
3141149997,1cyclictest431973-21awk00:05:173
3141149997,1cyclictest1051-21snmpd21:40:063
3141149996,2cyclictest1051-21snmpd21:56:033
3141119996,2cyclictest1051-21snmpd23:19:392
3141119990,9cyclictest0-21swapper/221:18:142
3141119990,2cyclictest377180-21timerandwakeup21:45:222
3141069997,2cyclictest1051-21snmpd21:44:020
3141069996,2cyclictest1051-21snmpd19:55:480
3141069990,9cyclictest0-21swapper/020:51:140
3141069990,9cyclictest0-21swapper/019:21:510
3141149987,1cyclictest1051-21snmpd22:28:433
3141119980,1cyclictest391rcuc/222:55:202
3141069970,7cyclictest0-21swapper/020:40:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional