You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-29 - 05:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot2s.osadl.org (updated Wed Mar 29, 2023 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1340799132130,1cyclictest0-21swapper/019:12:310
1340899130122,7cyclictest0-21swapper/119:32:461
1340999123121,1cyclictest0-21swapper/219:32:462
57922970,1sleep00-21swapper/023:17:400
13407999693,2cyclictest24569-21strings19:32:460
214622910,0sleep10-21swapper/122:31:271
1294029148,32sleep20-21swapper/219:09:532
1299329047,31sleep30-21swapper/319:10:353
1287629048,31sleep00-21swapper/019:09:030
1278828946,31sleep10-21swapper/119:07:561
246552840,0sleep00-21swapper/023:04:330
13408993124,5cyclictest29205-21ssh00:11:141
143512240,0sleep00-21swapper/021:53:070
54292230,0sleep00-21swapper/000:19:240
39082230,1sleep10-21swapper/122:14:041
1340999231,21cyclictest0-21swapper/220:22:402
1340799230,21cyclictest25200-21chrt21:32:470
308782220,0sleep20-21swapper/222:08:562
265182210,1sleep20-21swapper/219:37:422
13410992119,1cyclictest0-21swapper/320:07:373
1341099210,20cyclictest34-21ksoftirqd/319:47:393
13409992010,6cyclictest12143-21ssh00:27:222
13408992014,2cyclictest31008-21ssh22:40:201
13408991914,3cyclictest9793-21ssh00:23:181
13408991911,2cyclictest19009-21ssh22:59:141
257302180,6sleep228-21ksoftirqd/200:41:022
1341099188,6cyclictest34-21ksoftirqd/322:05:573
1341099180,1cyclictest0-21swapper/300:07:373
1341099177,6cyclictest34-21ksoftirqd/323:05:253
1341099177,6cyclictest34-21ksoftirqd/322:50:293
1341099177,6cyclictest34-21ksoftirqd/321:21:553
1341099174,8cyclictest0-21swapper/321:49:103
222432160,1sleep00-21swapper/021:28:500
1341099168,5cyclictest34-21ksoftirqd/322:46:373
1341099167,6cyclictest34-21ksoftirqd/321:26:053
1341099167,5cyclictest34-21ksoftirqd/323:36:563
1341099166,7cyclictest34-21ksoftirqd/321:11:323
1341099166,6cyclictest34-21ksoftirqd/323:54:513
1341099166,6cyclictest34-21ksoftirqd/323:54:513
1341099166,6cyclictest34-21ksoftirqd/323:24:573
1341099166,6cyclictest34-21ksoftirqd/322:30:573
1341099163,5cyclictest34-21ksoftirqd/300:32:383
1340899163,8cyclictest23619-21grep22:02:481
1341099157,5cyclictest597-21gdbus00:02:243
1341099157,5cyclictest34-21ksoftirqd/321:31:503
1341099157,3cyclictest34-21ksoftirqd/323:08:503
1341099156,5cyclictest34-21ksoftirqd/321:40:333
1341099156,2cyclictest34-21ksoftirqd/323:37:243
1341099154,6cyclictest34-21ksoftirqd/322:57:413
1340999155,8cyclictest0-21swapper/223:30:502
1340999151,2cyclictest0-21swapper/223:02:442
1340899158,6cyclictest30436-21ssh21:37:441
1340899158,5cyclictest10164-21sh21:49:561
1340899150,2cyclictest141rcu_preempt23:19:081
1340799151,7cyclictest20707-21munin-run23:32:240
1341099146,5cyclictest34-21ksoftirqd/322:21:163
1341099146,5cyclictest34-21ksoftirqd/322:21:163
1341099146,5cyclictest34-21ksoftirqd/320:14:373
1341099146,5cyclictest34-21ksoftirqd/319:14:383
1341099145,6cyclictest34-21ksoftirqd/323:43:243
1341099145,6cyclictest34-21ksoftirqd/322:15:003
1341099145,5cyclictest141rcu_preempt23:22:123
1341099144,7cyclictest34-21ksoftirqd/323:47:503
1341099144,7cyclictest34-21ksoftirqd/320:42:153
1341099144,6cyclictest34-21ksoftirqd/322:38:033
1341099144,6cyclictest34-21ksoftirqd/321:03:193
1341099142,7cyclictest34-21ksoftirqd/322:52:493
13410991410,3cyclictest34-21ksoftirqd/319:42:373
1340999145,7cyclictest23698-21pmu-power22:32:492
13409991411,2cyclictest28-21ksoftirqd/221:22:262
1340999140,10cyclictest10137-21ssh22:51:462
1340899149,3cyclictest9872-21ssh22:19:581
1340899149,3cyclictest9872-21ssh22:19:581
1340899149,3cyclictest24409-21ssh00:38:461
1340899144,5cyclictest0-21swapper/123:56:181
1340899144,5cyclictest0-21swapper/123:56:181
1340899144,5cyclictest0-21swapper/120:41:471
1340899141,1cyclictest141rcu_preempt00:32:381
1340799144,6cyclictest26809-21ssh22:05:470
1340799144,5cyclictest0-21swapper/023:48:090
1340799144,5cyclictest0-21swapper/023:14:490
274182131,2sleep20-21swapper/223:07:412
1341099137,2cyclictest34-21ksoftirqd/321:33:303
1341099135,6cyclictest0-21swapper/319:37:363
1341099135,4cyclictest141rcu_preempt00:12:303
1341099133,6cyclictest34-21ksoftirqd/321:42:363
1341099132,7cyclictest34-21ksoftirqd/320:35:343
1341099132,7cyclictest34-21ksoftirqd/300:37:503
1341099132,7cyclictest34-21ksoftirqd/300:22:263
1341099132,6cyclictest34-21ksoftirqd/322:35:203
1341099132,6cyclictest34-21ksoftirqd/322:08:123
1341099131,8cyclictest34-21ksoftirqd/300:02:373
1341099131,3cyclictest34-21ksoftirqd/320:43:083
13410991310,2cyclictest331rcuc/323:12:253
1341099130,3cyclictest331rcuc/320:32:243
1340999136,5cyclictest536-21in:imuxsock23:47:562
1340999136,5cyclictest21327-21cut20:37:372
1340999136,5cyclictest12664-21cat22:52:532
1340899137,5cyclictest0-21swapper/119:24:151
1340899134,4cyclictest30454-21apt-get19:47:391
1340899134,4cyclictest0-21swapper/122:45:331
1340899134,4cyclictest0-21swapper/120:59:201
1340899133,7cyclictest22586-21/usr/sbin/munin23:02:461
1340899133,6cyclictest22-21ksoftirqd/122:07:461
1340899132,4cyclictest141rcu_preempt21:52:581
1340799133,5cyclictest0-21swapper/020:54:230
1340799133,5cyclictest0-21swapper/020:08:340
1340799133,5cyclictest0-21swapper/019:42:420
1340799132,9cyclictest0-21swapper/023:37:410
1341099129,2cyclictest331rcuc/322:23:343
1341099129,2cyclictest331rcuc/321:52:263
1341099127,3cyclictest34-21ksoftirqd/319:22:243
1341099125,6cyclictest0-21swapper/323:27:323
1341099124,3cyclictest0-21swapper/320:50:593
1341099123,6cyclictest34-21ksoftirqd/321:57:483
1341099123,2cyclictest331rcuc/320:17:443
1341099122,6cyclictest34-21ksoftirqd/321:12:383
1341099122,5cyclictest34-21ksoftirqd/300:18:443
1341099121,9cyclictest30868-21cpuspeed_turbos20:57:393
1341099120,2cyclictest34-21ksoftirqd/300:29:373
1340999128,3cyclictest28-21ksoftirqd/219:27:242
1340999128,2cyclictest24172-21grep20:42:452
1340999126,4cyclictest7799-21ssh23:18:522
1340999126,4cyclictest4626-21seq23:16:592
1340999126,4cyclictest31304-21irqstats19:47:462
1340999126,4cyclictest14357-21users00:27:562
1340999126,4cyclictest1417-21ls22:42:442
1340999126,1cyclictest28-21ksoftirqd/220:57:452
1340999125,6cyclictest0-21swapper/223:01:462
1340999125,3cyclictest21350-1kworker/u9:222:03:512
1340999124,3cyclictest0-21swapper/222:00:232
1340999124,3cyclictest0-21swapper/221:52:482
1340999124,3cyclictest0-21swapper/220:05:132
1340999123,4cyclictest0-21swapper/221:35:012
1340999123,4cyclictest0-21swapper/219:44:302
1340999122,8cyclictest1550-21grep22:12:412
1340999121,3cyclictest232-21systemd-journal23:32:242
1340999120,4cyclictest17812-21grep22:27:392
1340999120,10cyclictest2895-21awk21:07:422
1340999120,10cyclictest15548-21sh21:22:242
1340899127,4cyclictest3022-21ssh23:14:401
1340899126,5cyclictest0-21swapper/123:50:161
1340899126,4cyclictest232-21systemd-journal19:52:571
1340899126,4cyclictest10652-21tr23:22:371
1340899125,6cyclictest22-21ksoftirqd/121:23:421
1340899125,5cyclictest0-21swapper/122:56:311
1340899125,5cyclictest0-21swapper/121:28:271
1340899125,4cyclictest0-21swapper/121:06:381
1340899124,5cyclictest23621-21/usr/sbin/munin20:42:421
1340899124,5cyclictest0-21swapper/120:56:321
1340899124,5cyclictest0-21swapper/120:36:101
1340899124,5cyclictest0-21swapper/119:58:251
1340899124,5cyclictest0-21swapper/100:04:401
1340899124,4cyclictest0-21swapper/120:05:201
1340899124,3cyclictest0-21swapper/121:12:481
1340899123,4cyclictest0-21swapper/122:01:141
1340899122,6cyclictest14764-21df20:22:421
1340899122,5cyclictest0-21swapper/121:45:551
1340899121,8cyclictest28980-21ssh23:08:081
1340899121,6cyclictest206-21jbd2/sda1-820:09:011
1340899121,4cyclictest141rcu_preempt23:39:321
1340899120,2cyclictest24069-21ssh23:34:421
1340799124,7cyclictest0-21swapper/023:47:060
1340799122,5cyclictest0-21swapper/023:54:030
1340799122,5cyclictest0-21swapper/023:54:030
1341099117,2cyclictest930-21grep19:52:423
1341099117,2cyclictest23125-21latency_hist19:32:253
1341099115,4cyclictest15392-21tail20:22:503
1341099113,3cyclictest34-21ksoftirqd/320:53:083
1341099112,6cyclictest0-21swapper/319:32:493
1341099112,3cyclictest34-21ksoftirqd/319:57:403
1341099111,6cyclictest34-21ksoftirqd/319:22:453
1340999117,2cyclictest3706-21grep19:57:452
1340999116,3cyclictest536-21in:imuxsock00:18:462
1340999116,3cyclictest32033-21unixbench_singl00:12:532
1340999116,3cyclictest17298-21cut00:32:382
1340999116,3cyclictest13343-21sh23:24:092
1340999115,4cyclictest6862-21grep22:17:452
1340999115,4cyclictest6862-21grep22:17:452
1340999115,4cyclictest19690-21seq20:32:432
1340999115,4cyclictest10863-21head20:12:462
1340999114,6cyclictest0-21swapper/223:57:392
1340999114,6cyclictest0-21swapper/223:46:442
1340999114,5cyclictest0-21swapper/220:57:142
1340999114,1cyclictest28-21ksoftirqd/221:42:512
1340999113,6cyclictest28-21ksoftirqd/221:47:422
1340999113,6cyclictest0-21swapper/222:39:472
1340999110,6cyclictest0-21swapper/222:23:032
1340999110,6cyclictest0-21swapper/220:11:012
1340999110,5cyclictest32731-21/usr/sbin/munin19:52:442
1340999110,5cyclictest25402-21cut00:07:392
1340899116,4cyclictest2374-21basename00:17:251
1340899115,5cyclictest0-21swapper/119:43:151
1340899115,5cyclictest0-21swapper/100:28:241
1340899115,4cyclictest232-21systemd-journal21:32:561
1340899115,4cyclictest22726-21grep22:32:381
1340899115,4cyclictest21501-21df19:27:401
1340899114,6cyclictest0-21swapper/122:50:141
1340899114,5cyclictest3049-21ssh23:45:541
1340899114,5cyclictest27233-21ls19:37:491
1340899114,5cyclictest0-21swapper/120:49:201
1340899114,4cyclictest0-21swapper/123:30:461
1340899114,4cyclictest0-21swapper/122:24:021
1340899114,4cyclictest0-21swapper/120:29:401
1340899113,5cyclictest0-21swapper/119:19:391
1340899111,3cyclictest0-21swapper/121:20:541
1340799119,1cyclictest2835-21chrt21:07:420
1340799117,3cyclictest12-21ksoftirqd/022:12:390
1340799117,2cyclictest14074-21dump-pmu-power20:22:240
1340799115,5cyclictest27249-21tr23:07:390
1340799115,5cyclictest0-21swapper/022:40:420
1340799115,5cyclictest0-21swapper/021:24:150
1340799115,5cyclictest0-21swapper/020:25:370
1340799115,5cyclictest0-21swapper/000:23:490
1340799115,4cyclictest0-21swapper/022:47:480
1340799113,7cyclictest0-21swapper/020:37:420
1340799111,6cyclictest18790-21ssh22:58:550
1340799111,5cyclictest25808-21/usr/sbin/munin19:37:510
1340799110,6cyclictest12584-21ssh21:18:090
1340799110,6cyclictest11432-21ssh22:52:430
1340799110,10cyclictest0-21swapper/019:17:490
1341099102,5cyclictest34-21ksoftirqd/320:02:483
1340999108,1cyclictest0-21swapper/221:02:382
1340999106,2cyclictest4889-21diskmemload21:12:272
1340999106,2cyclictest26921-21strings20:47:472
1340999106,2cyclictest18699-21ls20:32:242
1340999105,4cyclictest14694-21gzip19:12:542
1340999105,4cyclictest0-21swapper/221:39:252
1340999105,3cyclictest26572-21cpuspeed_turbos23:37:412
1340999105,3cyclictest24532-21sh21:32:092
1340999105,3cyclictest20788-21tr00:02:402
1340999104,4cyclictest17512-21tr19:17:452
1340999104,4cyclictest10732-21cat23:52:452
1340999104,4cyclictest10732-21cat23:52:452
1340999101,7cyclictest0-21swapper/220:17:392
1340999100,4cyclictest21053-21/usr/sbin/munin19:27:402
1340899106,2cyclictest13732-21cpuspeed_turbos19:12:451
1340899104,5cyclictest0-21swapper/123:58:321
1340899104,5cyclictest0-21swapper/120:12:321
1340899104,5cyclictest0-21swapper/100:17:321
1340899104,4cyclictest0-21swapper/121:12:161
1340899102,3cyclictest13111-21ntp_states20:17:481
1340799107,2cyclictest30986-21hwlatdetect00:12:440
1340799105,4cyclictest232-21systemd-journal21:58:570
1340799105,4cyclictest12556-21uniq22:22:480
1340799105,4cyclictest0-21swapper/022:32:120
1340799105,4cyclictest0-21swapper/021:38:220
1340799105,3cyclictest31507-21latency20:57:450
1340799104,5cyclictest0-21swapper/023:59:300
1340799104,5cyclictest0-21swapper/023:24:230
1340799104,5cyclictest0-21swapper/022:45:240
1340799104,5cyclictest0-21swapper/021:47:550
1340799104,5cyclictest0-21swapper/021:43:310
1340799104,5cyclictest0-21swapper/019:53:310
1340799104,5cyclictest0-21swapper/019:26:540
1340799104,5cyclictest0-21swapper/000:32:280
1340799104,5cyclictest0-21swapper/000:32:100
1340799104,5cyclictest0-21swapper/000:03:420
1340799104,4cyclictest7821-21ntp_kernel_pll_22:17:520
1340799104,4cyclictest7821-21ntp_kernel_pll_22:17:520
1340799104,4cyclictest6089-21sed20:02:500
1340799104,4cyclictest0-21swapper/020:17:070
1340799103,5cyclictest5258-21ssh21:12:390
1340799102,3cyclictest0-21swapper/020:48:160
134079996,2cyclictest31793-21switchtime19:47:510
134079995,3cyclictest19187-21kworker/u8:023:32:260
134079995,2cyclictest973-21cut21:02:460
134079995,2cyclictest22674-21cpuspeed_turbos22:32:380
134079995,2cyclictest22356-21grep00:37:420
134079994,4cyclictest28720-21expr22:07:430
134079994,4cyclictest0-21swapper/020:37:110
134079994,3cyclictest16907-21cut20:27:450
134079993,5cyclictest575-21snmpd20:47:230
134079993,5cyclictest3116-21tune2fs19:57:400
134079993,5cyclictest0-21swapper/000:07:390
134079984,3cyclictest21075-21apt-get19:27:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional