You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 07:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot7s.osadl.org (updated Sat Apr 20, 2024 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2845934212371,43sleep20-21swapper/219:07:292
2845871211973,20sleep30-21swapper/319:06:423
2845841211872,20sleep10-21swapper/119:06:211
2845787211868,21sleep00-21swapper/019:05:390
284629499270,3cyclictest0-21swapper/122:51:081
112099260,0ntpd0-21swapper/300:20:193
284629499230,15cyclictest0-21swapper/123:23:321
284630099206,13cyclictest0-21swapper/322:35:153
2846294992018,1cyclictest1026-21snmpd23:06:431
2846294992018,1cyclictest1026-21snmpd23:06:421
284630099190,3cyclictest0-21swapper/322:49:213
284629699190,19cyclictest2966903-21hardlink23:53:232
284629499190,4cyclictest0-21swapper/119:24:361
284629499190,3cyclictest0-21swapper/123:03:581
284629499190,19cyclictest2981828-21hardlink23:54:091
284630099185,13cyclictest0-21swapper/320:57:453
2846300991810,8cyclictest0-21swapper/321:24:253
284630099180,17cyclictest2962403-21dracut-install23:53:153
2846296991815,2cyclictest1026-21snmpd21:15:002
2846296991815,2cyclictest1026-21snmpd19:12:082
284629499188,10cyclictest0-21swapper/121:06:231
284629499180,3cyclictest0-21swapper/121:54:261
284629499180,3cyclictest0-21swapper/121:40:161
284629499180,17cyclictest0-21swapper/122:24:211
284629499180,17cyclictest0-21swapper/120:51:151
2846300991714,2cyclictest1026-21snmpd22:42:543
284630099170,16cyclictest0-21swapper/319:45:183
2846296991716,1cyclictest1026-21snmpd00:33:032
2846296991715,1cyclictest1026-21snmpd22:33:002
2846294991712,5cyclictest0-21swapper/122:04:191
284629499170,3cyclictest0-21swapper/121:23:581
284629499170,17cyclictest0-21swapper/100:05:161
284629499170,16cyclictest0-21swapper/123:16:511
284629499170,16cyclictest0-21swapper/122:13:251
284629499170,16cyclictest0-21swapper/120:35:291
2846290991714,2cyclictest1026-21snmpd19:42:570
284629099170,17cyclictest0-21swapper/000:33:030
284629099170,16cyclictest0-21swapper/021:15:000
284630099167,4cyclictest0-21swapper/300:31:573
2846300991613,2cyclictest1026-21snmpd22:49:593
284630099161,14cyclictest3005973-21/usr/sbin/munin00:25:103
284630099160,7cyclictest0-21swapper/320:01:373
284630099160,2cyclictest0-21swapper/322:11:133
284630099160,16cyclictest0-21swapper/323:46:293
284630099160,16cyclictest0-21swapper/322:15:383
284630099160,16cyclictest0-21swapper/321:43:343
284630099160,16cyclictest0-21swapper/320:29:143
284630099160,16cyclictest0-21swapper/320:05:463
284630099160,16cyclictest0-21swapper/319:57:523
284630099160,16cyclictest0-21swapper/319:35:533
284630099160,15cyclictest0-21swapper/323:05:013
284630099160,15cyclictest0-21swapper/323:05:003
284629499162,13cyclictest2917305-21memory22:05:141
2846294991613,2cyclictest1026-21snmpd00:30:421
2846294991610,5cyclictest0-21swapper/123:33:041
284629499160,8cyclictest0-21swapper/120:02:401
284629499160,7cyclictest2943558-21awk23:10:191
284629499160,16cyclictest0-21swapper/120:47:531
284629499160,16cyclictest0-21swapper/120:31:501
284629499160,16cyclictest0-21swapper/120:08:401
284629099160,16cyclictest0-21swapper/022:33:000
284630099156,9cyclictest0-21swapper/322:09:383
284630099156,9cyclictest0-21swapper/320:44:503
2846300991511,4cyclictest0-21swapper/323:41:373
284629499156,9cyclictest0-21swapper/119:39:061
284629499155,10cyclictest0-21swapper/119:52:221
2846294991513,1cyclictest0-21swapper/120:20:171
2846294991512,2cyclictest1026-21snmpd21:28:311
2846294991510,5cyclictest0-21swapper/100:13:081
284629499150,6cyclictest0-21swapper/121:48:001
284629499150,15cyclictest0-21swapper/123:57:351
284629499150,15cyclictest0-21swapper/123:28:341
2846290991513,1cyclictest1026-21snmpd23:01:550
2846290991513,1cyclictest1026-21snmpd19:45:150
284629099150,15cyclictest0-21swapper/019:12:080
229699150,2rtkit-daemon2295-21rtkit-daemon00:29:181
2846300991410,4cyclictest0-21swapper/300:03:323
284630099140,6cyclictest0-21swapper/321:02:063
284630099140,6cyclictest0-21swapper/319:40:033
284629699149,5cyclictest2954151-21dnf23:38:352
2846296991413,1cyclictest1026-21snmpd22:00:532
2846294991411,2cyclictest795-21systemd-machine23:38:171
284629499140,6cyclictest0-21swapper/119:55:281
284629499140,5cyclictest0-21swapper/121:15:181
284629499140,13cyclictest0-21swapper/122:35:101
112099140,2ntpd2879698-21ntpq20:30:193
284630099139,4cyclictest0-21swapper/320:17:193
284630099134,9cyclictest0-21swapper/321:46:253
2846300991311,2cyclictest1026-21snmpd23:15:223
2846300991310,2cyclictest1026-21snmpd22:59:523
284630099130,13cyclictest0-21swapper/322:20:163
284630099130,13cyclictest0-21swapper/320:45:233
284629499139,1cyclictest0-21swapper/122:17:351
284629499138,5cyclictest0-21swapper/120:19:351
284629499137,5cyclictest0-21swapper/122:29:321
284629499130,5cyclictest0-21swapper/120:44:021
284629499130,13cyclictest0-21swapper/121:35:171
2846290991311,2cyclictest717995-21Xorg23:54:410
284629099130,13cyclictest0-21swapper/022:00:520
112099130,0ntpd0-21swapper/023:38:180
284630099129,2cyclictest1026-21snmpd23:31:533
284630099129,2cyclictest1026-21snmpd23:23:503
284630099129,2cyclictest1026-21snmpd22:28:563
284630099129,2cyclictest1026-21snmpd21:32:583
284630099129,2cyclictest1026-21snmpd20:22:533
284630099129,2cyclictest1026-21snmpd19:50:433
284630099129,2cyclictest1026-21snmpd19:27:423
284630099127,5cyclictest0-21swapper/320:38:113
284630099123,9cyclictest0-21swapper/321:36:163
284630099123,9cyclictest0-21swapper/319:10:263
284630099120,12cyclictest0-21swapper/323:13:343
284629699129,2cyclictest1026-21snmpd22:54:032
284629699129,2cyclictest1026-21snmpd20:49:142
2846296991211,1cyclictest41-21ksoftirqd/219:45:152
2846296991211,1cyclictest0-21swapper/219:44:092
2846296991210,2cyclictest2958308-21dnf23:48:042
2846296991210,1cyclictest2909224-21awk21:45:162
2846296991210,1cyclictest1026-21snmpd23:09:102
2846296991210,1cyclictest1026-21snmpd23:09:092
2846296991210,1cyclictest1026-21snmpd20:24:502
284629499129,2cyclictest1026-21snmpd22:55:401
284629499129,2cyclictest1026-21snmpd21:03:541
284629499128,4cyclictest0-21swapper/119:34:151
284629499127,1cyclictest0-21swapper/122:46:541
2846294991210,1cyclictest0-21swapper/120:58:211
284629099129,2cyclictest1026-21snmpd22:14:200
2846290991211,1cyclictest0-21swapper/023:14:130
2846290991211,1cyclictest0-21swapper/000:11:170
2846290991210,1cyclictest1026-21snmpd21:53:380
2846290991210,1cyclictest1026-21snmpd20:29:290
112099120,8ntpd2901566-21ntpq21:25:183
112099120,1ntpd0-21swapper/223:55:152
284630099119,1cyclictest1026-21snmpd23:28:283
284630099118,2cyclictest2998654-21awk00:05:123
284630099118,2cyclictest2897133-21fschecks_time21:15:103
284630099118,2cyclictest1026-21snmpd23:56:363
284630099118,2cyclictest1026-21snmpd19:30:363
284630099118,2cyclictest1026-21snmpd19:24:063
284630099118,2cyclictest1026-21snmpd00:15:143
284630099117,4cyclictest0-21swapper/321:56:073
284630099113,8cyclictest0-21swapper/300:38:343
284630099112,9cyclictest0-21swapper/323:36:433
284629699119,2cyclictest1026-21snmpd00:11:182
284629699119,1cyclictest1026-21snmpd23:01:372
284629699119,1cyclictest1026-21snmpd20:15:012
284629699119,1cyclictest1026-21snmpd20:02:282
284629699119,1cyclictest1026-21snmpd00:36:002
284629699118,2cyclictest1026-21snmpd19:37:152
284629699117,4cyclictest2850391-40dnf19:15:352
2846296991110,1cyclictest1026-21snmpd00:23:212
284629499119,1cyclictest1026-21snmpd19:25:121
284629499119,1cyclictest1026-21snmpd00:24:031
284629499119,1cyclictest1026-21snmpd00:04:031
284629499118,2cyclictest1026-21snmpd20:27:101
284629499118,2cyclictest1026-21snmpd20:10:581
284629499118,2cyclictest1026-21snmpd00:37:361
284629099119,2cyclictest1026-21snmpd22:19:070
284629099119,1cyclictest1026-21snmpd21:57:500
284629099119,1cyclictest1026-21snmpd21:01:270
284629099119,1cyclictest1026-21snmpd20:43:260
284629099119,1cyclictest1026-21snmpd20:12:010
284629099119,1cyclictest1026-21snmpd19:55:400
284629099119,1cyclictest1026-21snmpd00:06:530
284629099118,2cyclictest1026-21snmpd23:28:100
284629099118,2cyclictest1026-21snmpd23:20:230
2846290991110,1cyclictest16-21ksoftirqd/020:45:290
2846290991110,1cyclictest0-21swapper/022:20:290
2846290991110,1cyclictest0-21swapper/021:45:420
2846290991110,1cyclictest0-21swapper/020:16:430
112099110,0ntpd0-21swapper/123:48:051
284630099107,2cyclictest718060-21JS15:19:023
284630099105,5cyclictest0-21swapper/321:53:233
284630099100,10cyclictest0-21swapper/322:31:123
284630099100,10cyclictest0-21swapper/319:16:363
284629699109,1cyclictest1026-21snmpd22:25:442
284629699109,1cyclictest1026-21snmpd21:39:582
284629699108,1cyclictest1026-21snmpd23:20:022
284629699108,1cyclictest1026-21snmpd23:10:212
284629699108,1cyclictest1026-21snmpd20:25:472
284629699108,1cyclictest1026-21snmpd00:07:292
284629699107,2cyclictest1026-21snmpd22:07:442
284629699107,2cyclictest1026-21snmpd00:26:402
284629699107,2cyclictest1026-21snmpd00:02:332
284629699100,1cyclictest0-21swapper/223:25:132
284629499109,1cyclictest1026-21snmpd21:12:001
284629499109,1cyclictest0-21swapper/119:17:531
284629499108,1cyclictest2955226-21awk23:40:121
284629499107,2cyclictest1026-21snmpd22:31:511
284629499100,10cyclictest0-21swapper/119:49:001
284629499100,10cyclictest0-21swapper/100:15:531
284629099109,1cyclictest1026-21snmpd23:55:320
284629099109,1cyclictest1026-21snmpd20:30:140
284629099109,1cyclictest1026-21snmpd20:23:410
284629099109,1cyclictest1018-21nmbd00:37:450
284629099109,1cyclictest0-21swapper/020:59:000
284629099109,1cyclictest0-21swapper/000:02:330
284629099108,1cyclictest1026-21snmpd22:06:110
284629099108,1cyclictest1026-21snmpd21:38:040
284629099108,1cyclictest1018-21nmbd22:54:350
284629099107,2cyclictest1026-21snmpd23:31:160
284629099101,9cyclictest0-21swapper/020:09:580
2846290991010,0cyclictest0-21swapper/019:38:060
28463009998,1cyclictest1026-21snmpd00:10:423
28463009997,1cyclictest1026-21snmpd20:52:183
28463009996,2cyclictest1026-21snmpd21:10:273
28463009990,9cyclictest0-21swapper/322:00:563
28462969998,1cyclictest718065-21llvmpipe-221:50:592
28462969998,1cyclictest2899648-21grep21:20:212
28462969998,1cyclictest1026-21snmpd22:20:292
28462969998,1cyclictest1026-21snmpd20:09:282
28462969997,1cyclictest1026-21snmpd22:40:542
28462969997,1cyclictest1018-21nmbd22:36:242
28462969996,2cyclictest883-21abrt-dump-journ21:10:002
28462969996,2cyclictest1026-21snmpd20:38:142
28462969996,2cyclictest1026-21snmpd19:33:162
28462969990,8cyclictest2907488-21ntpq21:40:172
28462949998,1cyclictest0-21swapper/122:40:181
28462949996,2cyclictest1026-21snmpd21:30:061
28462949990,9cyclictest0-21swapper/119:40:511
28462949990,9cyclictest0-21swapper/119:11:501
28462909999,0cyclictest1026-21snmpd19:51:280
28462909998,1cyclictest1026-21snmpd23:08:370
28462909998,1cyclictest1026-21snmpd23:08:360
28462909998,1cyclictest1026-21snmpd21:20:210
28462909998,1cyclictest1026-21snmpd19:15:260
28462909998,1cyclictest0-21swapper/022:39:240
28462909997,1cyclictest1026-21snmpd22:55:330
28462909997,1cyclictest1026-21snmpd22:47:510
28462909997,1cyclictest1026-21snmpd21:41:460
28462909996,2cyclictest1026-21snmpd23:46:200
28462909996,2cyclictest1026-21snmpd20:01:280
28462909996,2cyclictest1026-21snmpd00:20:180
11209990,1ntpd2871875-21rt-features20:10:183
28463009987,1cyclictest1026-21snmpd21:08:453
28462969987,1cyclictest718064-21llvmpipe-119:58:582
28462969987,1cyclictest718063-21llvmpipe-021:25:592
28462969987,1cyclictest2956167-40dnf23:42:252
28462969987,1cyclictest2950470-21cpu23:30:122
28462969987,1cyclictest2944917-21grep23:15:152
28462969987,1cyclictest2921028-21grep22:15:132
28462969987,1cyclictest2903558-21ntpq21:30:162
28462969987,1cyclictest2893149-21grep21:05:142
28462969987,1cyclictest2889201-21perl20:55:122
28462969987,1cyclictest2883644-21ntpq20:40:152
28462969987,1cyclictest2863810-21ntpq19:50:252
28462969987,1cyclictest2853029-21cpuspeed19:25:102
28462969987,1cyclictest2851110-21cstates19:20:082
28462969987,1cyclictest0-21swapper/221:57:502
28462969980,2cyclictest2890718-21/usr/sbin/munin21:00:112
28462909988,0cyclictest1026-21snmpd19:21:410
28462909987,1cyclictest1026-21snmpd22:25:320
28462909987,1cyclictest0-21swapper/021:31:100
28462909987,1cyclictest0-21swapper/000:26:160
28462909986,1cyclictest1026-21snmpd21:09:080
28462909980,8cyclictest0-21swapper/023:18:240
28462909980,8cyclictest0-21swapper/022:43:530
28462909980,8cyclictest0-21swapper/020:35:060
11209980,1ntpd2955358-21memory23:40:130
11209980,1ntpd2912590-21/usr/sbin/munin21:55:141
28462969976,1cyclictest2932915-21grep22:45:162
28462969976,1cyclictest2879673-21ntpq20:30:182
28462969975,2cyclictest2887706-21pmu-power20:50:242
28462969975,2cyclictest1026-21snmpd20:14:012
28462969975,1cyclictest2936530-21/usr/sbin/munin22:55:142
28462969974,3cyclictest41-21ksoftirqd/200:15:132
28462909977,0cyclictest0-21swapper/020:52:590
28462909976,1cyclictest2901127-21fschecks_time21:25:120
28462909976,1cyclictest2894859-21cstates21:10:100
28462909976,1cyclictest2853491-21tune2fs19:25:130
28462909975,2cyclictest3002351-21fschecks_count00:15:150
28462909970,7cyclictest0-21swapper/019:33:150
28462969960,1cyclictest0-21swapper/222:10:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional