You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-31 - 06:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-6100U @2300 MHz, Linux 5.15.79-rt54 (Profile)

Latency plot of shadow in rack #7, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot7s.osadl.org (updated Wed May 31, 2023 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1113821190,0sleep10-21swapper/122:35:451
31425210475,9sleep10-21swapper/119:06:181
3159329986,9sleep30-21swapper/319:08:293
3157027563,8sleep00-21swapper/019:08:100
3145827262,6sleep20-21swapper/219:06:432
68442580,0sleep30-21swapper/323:20:203
29402470,0sleep30-21swapper/321:17:543
3180099270,1cyclictest0-21swapper/023:58:390
3180099260,1cyclictest0-21swapper/022:17:480
3180599240,24cyclictest0-21swapper/223:17:262
31804992421,2cyclictest25-21ksoftirqd/100:25:201
3180599230,21cyclictest0-21swapper/223:47:362
3180099212,0cyclictest0-21swapper/022:03:410
3180099210,1cyclictest0-21swapper/023:09:170
3180099210,1cyclictest0-21swapper/000:19:480
31805992019,1cyclictest0-21swapper/223:41:562
31805992019,1cyclictest0-21swapper/222:26:212
31805992019,1cyclictest0-21swapper/200:19:482
3180599200,18cyclictest0-21swapper/200:25:092
3180599200,16cyclictest0-21swapper/223:58:042
3180099200,2cyclictest0-21swapper/023:43:110
3180099200,1cyclictest0-21swapper/022:59:100
31805991918,1cyclictest0-21swapper/222:32:082
31805991913,5cyclictest0-21swapper/222:17:482
31800991911,6cyclictest472-21avahi-daemon00:05:320
31800991911,6cyclictest472-21avahi-daemon00:05:320
3180099190,2cyclictest0-21swapper/023:14:200
3180099190,1cyclictest0-21swapper/022:40:360
3180099190,1cyclictest0-21swapper/000:21:510
3180799180,6cyclictest0-21swapper/323:07:053
31805991817,1cyclictest30306-21kworker/2:222:57:582
31805991817,1cyclictest0-21swapper/220:05:222
3180599181,17cyclictest0-21swapper/222:00:382
3180499180,18cyclictest0-21swapper/122:13:411
3180499180,17cyclictest0-21swapper/123:26:541
31800991817,1cyclictest0-21swapper/020:05:220
3180099180,0cyclictest0-21swapper/022:25:230
3180799170,16cyclictest0-21swapper/300:34:543
31805991715,2cyclictest0-21swapper/200:13:122
31805991714,2cyclictest32-21ksoftirqd/221:23:132
3180599170,1cyclictest0-21swapper/223:05:022
3180599170,17cyclictest21488-21kworker/2:021:11:582
3180599170,15cyclictest0-21swapper/223:21:522
3180599170,15cyclictest0-21swapper/221:41:332
3180099170,17cyclictest0-21swapper/023:47:220
3180799163,10cyclictest28584-21ssh00:25:223
31805991615,1cyclictest24170-21diskmemload21:37:372
31805991615,1cyclictest0-21swapper/222:40:372
3180599160,2cyclictest0-21swapper/221:52:282
3180599160,16cyclictest0-21swapper/200:21:192
31804991613,2cyclictest10550irq/122-ahci[0023:35:331
3180499160,1cyclictest141rcu_preempt00:02:501
3180499160,12cyclictest1659-21awk22:30:001
3180099160,1cyclictest0-21swapper/000:30:060
208612160,0chrt20862-21sshd23:53:423
31807991513,2cyclictest39-21ksoftirqd/322:54:533
31805991514,1cyclictest0-21swapper/223:14:202
31805991513,1cyclictest0-21swapper/222:45:252
31805991512,3cyclictest0-21swapper/223:51:532
31805991512,1cyclictest0-21swapper/222:20:502
3180599151,13cyclictest11425-21ssh23:00:212
3180599151,13cyclictest0-21swapper/200:02:362
3180499156,5cyclictest224-21systemd-journal21:15:011
31804991513,2cyclictest25-21ksoftirqd/100:07:591
31804991513,2cyclictest25-21ksoftirqd/100:07:591
3180099152,12cyclictest534-21snmpd21:56:110
3180099150,13cyclictest0-21swapper/000:13:530
31807991411,2cyclictest21260-21grep21:30:393
3180599145,8cyclictest5420-21apt-get20:30:212
31805991411,3cyclictest37850irq/131-snd_hda21:45:292
31804991410,3cyclictest8425-21latency_hist22:35:011
3180499140,1cyclictest0-21swapper/123:50:341
3180499140,1cyclictest0-21swapper/122:52:481
3180099149,2cyclictest6235-21grep23:20:000
3180099148,4cyclictest8045-21ntp_kernel_pll_23:20:270
3180099146,3cyclictest21095-21apt-get19:55:250
31800991412,1cyclictest0-21swapper/023:27:030
3180099140,1cyclictest0-21swapper/021:32:240
3180099140,13cyclictest0-21swapper/021:10:140
3180799139,3cyclictest6320-21ssh00:06:223
3180799139,3cyclictest6320-21ssh00:06:213
31807991310,2cyclictest7081-21tail20:30:373
31807991310,2cyclictest4208-21grep22:30:413
31807991310,2cyclictest32743-21basename20:20:003
31807991310,2cyclictest26582-21grep20:05:263
31807991310,2cyclictest15754-21cron00:15:013
31807991310,2cyclictest15255-21latency_hist23:49:593
31807991310,2cyclictest14552-21cron00:39:593
31807991310,2cyclictest13322-21sed23:00:383
3180799130,1cyclictest0-21swapper/323:18:293
31805991312,1cyclictest0-21swapper/222:53:332
31805991312,1cyclictest0-21swapper/222:06:562
31805991312,1cyclictest0-21swapper/221:56:542
31805991312,1cyclictest0-21swapper/221:15:142
31805991310,3cyclictest0-21swapper/221:26:462
3180499139,3cyclictest8249-21wc19:25:401
3180499139,3cyclictest15998-21aten2_r7power_e22:40:221
3180499139,3cyclictest14200-21tr19:40:261
3180499134,5cyclictest224-21systemd-journal22:10:001
3180499132,4cyclictest0-21swapper/122:15:221
31804991310,2cyclictest4746-21tr19:20:251
31804991310,2cyclictest25690-21tr23:10:261
31804991310,2cyclictest21662-21tr21:56:051
31804991310,2cyclictest14523-21grep21:50:301
3180099139,2cyclictest0-21swapper/023:53:380
3180099132,10cyclictest6431-21apache200:28:340
31800991311,1cyclictest0-21swapper/020:30:200
31800991310,2cyclictest10230-21wc19:30:300
3180099130,12cyclictest28901-21sort20:10:230
3180799129,2cyclictest9485-21grep20:35:363
3180799129,2cyclictest9125-21rm22:35:223
3180799129,2cyclictest8025-21ls19:25:363
3180799129,2cyclictest28539-21seq21:12:393
3180799129,2cyclictest2407-21ssh22:05:353
3180799129,2cyclictest13823-21seq20:45:343
3180799129,2cyclictest13823-21seq20:45:333
3180799129,2cyclictest13674-21cat21:25:323
3180799129,2cyclictest11802-21tr19:35:273
31807991211,1cyclictest62050irq/128-enp2s0-23:31:493
31807991211,1cyclictest0-21swapper/322:56:173
31807991210,1cyclictest30511-21grep00:00:273
31807991210,1cyclictest24521-21cat23:55:443
3180799120,12cyclictest0-21swapper/321:46:273
3180799120,11cyclictest4178-21systemctl19:20:013
3180599129,2cyclictest7441-21grep22:10:182
3180599129,2cyclictest3715-21tail19:15:392
3180599129,2cyclictest29864-21grep20:10:342
3180599129,2cyclictest28704-21sh23:35:292
3180599129,2cyclictest24558-21cat20:00:272
3180599129,2cyclictest0-21swapper/200:06:292
3180599129,2cyclictest0-21swapper/200:06:282
3180599121,2cyclictest1519-21taskset19:11:502
31805991211,1cyclictest0-21swapper/200:39:202
31805991211,1cyclictest0-21swapper/200:30:062
3180599120,7cyclictest0-21swapper/223:30:192
3180599120,2cyclictest0-21swapper/220:35:212
3180499129,2cyclictest7465-21sort21:20:381
3180499129,2cyclictest6291-21tail22:55:391
3180499129,2cyclictest584-21ssh23:15:281
3180499129,2cyclictest24764-21grep23:55:451
3180499129,2cyclictest22882-21ssh22:45:241
3180499129,2cyclictest22407-21cut22:20:361
3180499129,2cyclictest19977-21tr21:00:201
3180499128,3cyclictest27895-21grep22:00:351
3180499128,3cyclictest22722-21sed19:55:431
3180499128,3cyclictest19743-21wc19:50:271
3180499128,3cyclictest19531-21grep23:05:301
3180499128,3cyclictest14500-21head21:25:411
3180499121,6cyclictest0-21swapper/120:45:191
3180499121,6cyclictest0-21swapper/120:45:191
31800991210,1cyclictest14234-21grep20:45:410
31800991210,1cyclictest14234-21grep20:45:410
31800991210,1cyclictest14053-21grep21:50:250
3180099120,2cyclictest141rcu_preempt21:16:100
3180099120,12cyclictest0-21swapper/023:39:540
3180099120,11cyclictest8981-21sed22:10:310
3180099120,11cyclictest31687-21wc20:15:290
3180099120,0cyclictest0-21swapper/022:20:510
3180799119,1cyclictest22769-21grep19:55:433
3180799119,1cyclictest15999-21chrt22:15:413
3180799118,2cyclictest7959-21rm22:10:223
3180799118,2cyclictest4951-21ssh23:41:403
3180799118,2cyclictest30029-21ssh23:36:143
3180799118,2cyclictest2757-21cron20:25:003
3180799118,2cyclictest25956-21cat21:59:593
3180799118,2cyclictest25334-21rm23:10:223
3180799118,2cyclictest22690-21expr21:05:213
3180799118,2cyclictest21997-21cat22:20:313
3180799118,2cyclictest21500-21taskset21:01:223
3180799118,2cyclictest19299-21ssh23:29:193
3180799118,2cyclictest19003-21sed20:55:383
3180799118,2cyclictest15599-21ssh22:40:053
3180799118,2cyclictest14993-21cat21:50:373
3180799118,2cyclictest11284-21cron19:34:593
3180799118,2cyclictest10291-21grep20:40:263
3180799111,9cyclictest26776-21ssh00:23:293
3180799110,7cyclictest0-21swapper/322:25:213
3180599119,1cyclictest23717-21sed21:05:332
3180599119,1cyclictest20421-21head21:00:232
3180599119,1cyclictest16369-21cat20:50:312
3180599118,2cyclictest22457-21cat19:55:392
3180599117,3cyclictest21156-21sh21:30:372
3180599113,5cyclictest14897-21sh22:39:342
3180599112,1cyclictest0-21swapper/223:26:362
3180599110,11cyclictest0-21swapper/219:35:242
3180599110,10cyclictest16055-21cron19:45:002
3180499119,1cyclictest25-21ksoftirqd/121:30:571
3180499118,2cyclictest9350-21cat20:35:371
3180499118,2cyclictest8583-21chrt21:45:411
3180499118,2cyclictest4645-21ssh00:31:171
3180499118,2cyclictest30295-21taskset20:14:281
3180499118,2cyclictest28036-21grep21:35:411
3180499118,2cyclictest22198-21ssh00:20:091
3180499118,2cyclictest21160-21ssh23:30:221
3180499118,2cyclictest18437-21sh19:50:001
3180499118,2cyclictest17019-21cron20:55:001
3180499118,2cyclictest1343-21wc21:40:291
3180499118,2cyclictest12898-21ssh00:38:121
3180499118,2cyclictest12841-21ssh23:24:421
3180499118,2cyclictest12296-21basename20:45:001
3180499118,2cyclictest1114-21ssh21:16:001
3180499117,3cyclictest241rcuc/120:25:231
3180499117,3cyclictest1914-21tr20:20:401
3180499117,3cyclictest10174-21grep23:45:281
3180499113,3cyclictest25884-21apt-get20:05:221
3180099119,1cyclictest16620-21tr19:45:240
3180099119,1cyclictest15602-21sort20:50:190
3180099119,1cyclictest14040-21uname21:25:370
3180099119,1cyclictest12897-21cat21:49:590
3180099119,1cyclictest12738-21tr23:00:320
3180099119,1cyclictest0-21swapper/022:47:500
3180099118,2cyclictest9828-21expr22:35:270
3180099118,2cyclictest814-21ssh00:02:280
3180099118,2cyclictest806-21cut19:10:290
3180099118,2cyclictest6022-21sed19:20:410
3180099118,2cyclictest4497-21ssh21:43:010
3180099118,2cyclictest4120-21sshd19:19:420
3180099118,2cyclictest29932-21ssh22:50:220
3180099118,2cyclictest24951-21wc20:00:350
3180099118,2cyclictest20529-21ssh23:30:190
3180099118,2cyclictest19833-21cut21:00:210
3180099118,2cyclictest12690-21cut19:35:330
3180099118,2cyclictest12359-21sed20:45:000
3180099111,9cyclictest24170-21diskmemload21:20:240
3180099110,10cyclictest2594-21tail22:05:370
3180799108,2cyclictest28677-21cat20:10:203
3180799108,1cyclictest5521-21ssh21:20:153
3180799108,1cyclictest3304-21cut20:25:223
3180799108,1cyclictest26460-21ssh22:47:193
3180799108,1cyclictest26160-21ssh22:00:033
3180799108,1cyclictest20747-21taskset19:54:213
3180799108,1cyclictest1751-21taskset19:14:513
3180799108,1cyclictest16791-21chrt20:52:063
3180799108,1cyclictest16533-21cpuspeed_turbos19:45:233
3180799108,1cyclictest14288-21cat19:40:263
3180799107,2cyclictest32396-21ssh21:40:003
3180799107,2cyclictest16400-21grep00:15:243
3180799100,9cyclictest25666-21ssh21:35:003
3180799100,9cyclictest24372-21cat20:00:253
3180599108,1cyclictest9688-21df19:30:252
3180599108,1cyclictest6328-21chrt19:22:172
3180599107,2cyclictest646-21tr20:20:292
3180599107,2cyclictest32745-21apt20:19:592
3180599102,2cyclictest224-21systemd-journal19:25:422
3180499108,1cyclictest4144-21taskset19:19:591
3180499108,1cyclictest23052-21wc21:05:241
3180499107,2cyclictest5974-21sed20:30:241
3180499107,2cyclictest32300-21tr19:10:221
3180499107,2cyclictest30904-21tr20:15:231
3180499107,2cyclictest24825-21wc20:00:311
3180499107,2cyclictest18532-21ssh00:16:001
3180499107,2cyclictest1821-21ssh23:40:141
3180499107,2cyclictest17398-21cut20:55:221
3180499107,2cyclictest12323-21grep19:35:291
3180499107,2cyclictest11307-21cut00:10:301
3180499107,2cyclictest11089-21ssh23:00:041
3180099108,1cyclictest8885-21cut00:35:230
3180099108,1cyclictest840-21tr20:20:300
3180099108,1cyclictest7499-21cut19:25:290
3180099108,1cyclictest3029-21bc20:25:190
3180099108,1cyclictest28527-21ssh21:36:120
3180099108,1cyclictest205262sleep019:51:280
3180099108,1cyclictest157612sleep019:41:150
3180099107,2cyclictest9359-21cat20:35:370
3180099107,2cyclictest2960-21cut22:30:310
3180099101,5cyclictest224-21systemd-journal21:10:000
318079996,2cyclictest4445-21basename19:20:193
318059998,1cyclictest196282sleep219:50:272
318059997,2cyclictest12703-21grep20:45:212
318059997,2cyclictest12703-21grep20:45:202
318059997,2cyclictest10613-21cat20:40:262
318059997,1cyclictest3301-21grep20:25:222
318059996,3cyclictest17764-21expr20:55:242
318059996,2cyclictest16607-21tr19:45:232
318049995,3cyclictest11292-21cron19:35:001
318009996,2cyclictest17303-21apache_volume20:55:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional