You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-11-28 - 02:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

ARM Broadcom BCM2835 @1400 MHz, Linux 4.18.16-rt9 (Profile)

Latency plot of shadow in rack #7, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Mon Nov 28, 2022 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
257021010,2sleep00-21swapper/023:27:510
257021010,2sleep00-21swapper/023:27:510
940499981,4cyclictest29279-21idleruntime-cro20:05:170
940499961,5cyclictest20970-21taskset21:10:290
940499942,88cyclictest32486-21/usr/sbin/munin00:05:410
940499891,78cyclictest0-21swapper/022:15:490
940499882,83cyclictest24249-21kworker/u8:123:15:180
940499881,74cyclictest20473-21kworker/u8:022:05:180
940499871,71cyclictest1133-21runrttasks20:33:480
940499861,67cyclictest25841-21ps21:15:440
940499851,70cyclictest11818-21rm21:39:140
940499851,4cyclictest5154-21grep00:10:580
940499851,4cyclictest5154-21grep00:10:580
940499842,64cyclictest29927-21unixbench_singl23:20:520
940499842,61cyclictest0-21swapper/023:55:260
940499842,61cyclictest0-21swapper/023:55:260
940499841,4cyclictest1017-21fschecks_count20:15:380
940499832,65cyclictest0-21swapper/019:55:180
940499832,36cyclictest29080-21diskstats22:40:370
9404998320,44cyclictest125-21systemd-journal23:41:590
940499811,62cyclictest0-21swapper/022:15:190
940499811,5cyclictest32456-21grep20:10:480
940499811,3cyclictest0-21swapper/021:26:200
81262810,2sleep30-21swapper/323:35:193
182422810,4sleep2940699cyclictest23:46:572
940499801,65cyclictest0-21swapper/021:58:030
940499794,64cyclictest18535-21sh23:47:310
940499792,60cyclictest23958-21sh23:55:080
9404997920,35cyclictest24445-21latency_hist22:35:180
940499791,56cyclictest0-21swapper/021:30:470
141942790,2sleep20-21swapper/200:23:492
318412780,4sleep2940699cyclictest21:23:422
940499772,56cyclictest17785-21ssh23:05:520
940499771,61cyclictest0-21swapper/023:02:430
940499771,61cyclictest0-21swapper/022:37:520
940499771,4cyclictest10437-21ssh00:18:530
940499771,48cyclictest0-21swapper/023:17:560
940499771,3cyclictest0-21swapper/000:37:180
9404997713,46cyclictest16052-21sh22:24:530
940499771,2cyclictest0-21swapper/021:00:180
940499761,5cyclictest6722-21chrt22:52:410
940499752,60cyclictest0-21swapper/022:45:530
940499751,6cyclictest29544-21grep20:05:380
940499751,60cyclictest0-21swapper/021:52:430
940499751,3cyclictest0-21swapper/021:42:090
45292750,2sleep30-21swapper/322:10:333
940499743,59cyclictest0-21swapper/022:05:470
161512740,6sleep2940699cyclictest00:25:502
940499731,68cyclictest19083-21aten_rbpower_cu21:05:360
940499731,4cyclictest29348-21grep00:00:450
9407997217,39cyclictest11695-21sh22:19:183
940799721,60cyclictest1621-21/usr/sbin/munin20:15:473
940499722,60cyclictest0-21swapper/022:29:540
940499722,58cyclictest0-21swapper/019:26:520
940499721,3cyclictest0-21swapper/021:21:040
940499714,54cyclictest9403-21cyclictest22:58:550
940499712,54cyclictest0-21swapper/023:36:530
9404997118,38cyclictest18792-21cron21:05:180
940499711,4cyclictest131022sleep000:21:330
940499701,3cyclictest0-21swapper/019:37:020
940499701,3cyclictest0-21swapper/000:34:400
940499701,2cyclictest0-21swapper/021:47:240
96192690,3sleep19616-21grep22:15:541
940499692,52cyclictest0-21swapper/020:23:250
940499691,2cyclictest0-21swapper/000:29:220
9405996822,8cyclictest8050irq/56-dwc_otg_21:40:311
9404996844,14cyclictest0-21swapper/019:45:180
9404996844,14cyclictest0-21swapper/019:45:180
940499682,50cyclictest0-21swapper/020:39:000
940499682,50cyclictest0-21swapper/020:39:000
940499681,55cyclictest0-21swapper/023:31:150
940699677,43cyclictest8050irq/56-dwc_otg_23:20:442
940699677,42cyclictest0-21swapper/200:17:402
940499671,5cyclictest15141-21chrt20:54:410
940499671,3cyclictest0-21swapper/019:14:080
940699665,10cyclictest1749-21timerandwakeup20:15:482
940499661,4cyclictest26348-21if_wlan019:55:380
940799653,47cyclictest11994-21rm21:39:343
9406996511,5cyclictest1279-21grep00:05:522
940499651,12cyclictest0-21swapper/020:25:320
216242650,4sleep121626-21rt-features22:30:521
940799641,53cyclictest31632-21ssh22:43:413
940499643,4cyclictest18331-21latency_hist19:35:180
940799633,43cyclictest24723-21ssh22:35:373
940499631,4cyclictest0-21swapper/019:19:380
940499631,2cyclictest0-21swapper/020:44:110
940799623,49cyclictest27084-21ssh23:18:013
940799622,47cyclictest8050irq/56-dwc_otg_23:52:323
940799621,50cyclictest30158-21unixbench_singl22:00:503
940499621,3cyclictest0-21swapper/020:46:500
940799614,45cyclictest21334-21fschecks_time21:10:363
940799612,46cyclictest5810-21ssh23:31:213
940799611,50cyclictest19020-21ssh21:47:333
940799611,49cyclictest11519-21taskset20:44:383
940799611,46cyclictest24600-21cat23:55:333
940799611,46cyclictest24600-21cat23:55:333
940799611,37cyclictest8050irq/56-dwc_otg_21:55:353
940499611,2cyclictest0-21swapper/019:21:480
940799604,46cyclictest15966-21seq22:24:433
940799601,48cyclictest20621-21diskmemload00:27:133
940799601,44cyclictest14809-21ssh21:42:133
940799601,41cyclictest14239-21ssh23:42:003
940699603,4cyclictest8050irq/56-dwc_otg_20:00:182
9405996014,8cyclictest8050irq/56-dwc_otg_21:50:391
940499601,2cyclictest0-21swapper/019:50:110
940799593,43cyclictest14340-21runrttasks19:21:563
940799592,46cyclictest18707-21ssh22:27:163
940799592,42cyclictest1976-21ssh22:06:093
940799591,4cyclictest8050irq/56-dwc_otg_23:50:183
940799591,48cyclictest0-21swapper/300:14:043
940799591,48cyclictest0-21swapper/300:14:043
9407995912,38cyclictest8254-21cut22:55:193
940699592,11cyclictest0-21swapper/223:04:422
940799583,44cyclictest29006-21/usr/sbin/munin23:20:413
940799581,6cyclictest28429-21apt-get00:00:323
940799581,48cyclictest23233-21ssh21:52:523
940799581,45cyclictest23775-21gpgv19:50:183
940699586,4cyclictest0-21swapper/222:20:382
940699585,6cyclictest7950irq/56-dwc_otg_21:55:532
940699584,5cyclictest8050irq/56-dwc_otg_00:00:332
940699584,10cyclictest8050irq/56-dwc_otg_23:57:542
940699584,10cyclictest8050irq/56-dwc_otg_23:57:542
9406995818,25cyclictest29351-21irqstats22:40:412
940799575,32cyclictest8050irq/56-dwc_otg_23:04:413
940799572,41cyclictest31514-21df20:10:343
940799571,42cyclictest0-21swapper/321:34:153
940699571,8cyclictest8050irq/56-dwc_otg_21:36:582
9406995716,38cyclictest2706-21sh23:28:072
9406995716,38cyclictest2706-21sh23:28:072
940799566,36cyclictest0-21swapper/321:27:533
940799564,40cyclictest8050irq/56-dwc_otg_00:21:583
940799563,42cyclictest21208-21ssh00:32:283
940799562,42cyclictest25215-21snmpd20:23:533
940799561,44cyclictest0-21swapper/322:33:003
940799561,38cyclictest0-21swapper/322:47:543
940799561,37cyclictest8050irq/56-dwc_otg_20:05:473
940699561,4cyclictest8050irq/56-dwc_otg_23:52:382
940699561,4cyclictest20326-21/usr/sbin/munin00:30:572
940699561,13cyclictest0-21swapper/220:44:192
9406995610,6cyclictest0-21swapper/222:07:432
940799555,41cyclictest197962chrt19:37:283
940799553,42cyclictest26319-21ssh21:15:533
940799553,41cyclictest19053-21apt-get21:05:363
940799551,41cyclictest17841-21grep23:05:523
940699552,5cyclictest7850irq/56-dwc_otg22:50:352
9406995519,24cyclictest30075-21ssh22:00:492
940699551,4cyclictest7950irq/56-dwc_otg_20:10:372
940799541,4cyclictest2346-21ssh00:07:513
940799541,4cyclictest22834-21ssh23:12:373
940799541,41cyclictest306862chrt21:21:293
940699545,8cyclictest8050irq/56-dwc_otg_19:50:182
940699545,4cyclictest7850irq/56-dwc_otg21:45:182
940699544,4cyclictest7850irq/56-dwc_otg22:39:432
940699541,6cyclictest20267-21/usr/sbin/munin19:40:412
940699541,6cyclictest20267-21/usr/sbin/munin19:40:412
940699541,5cyclictest9781-21awk22:55:492
940699541,5cyclictest8050irq/56-dwc_otg_21:10:412
940699541,3cyclictest8050irq/56-dwc_otg_23:15:432
940699541,3cyclictest7950irq/56-dwc_otg_23:35:512
9406995410,4cyclictest0-21swapper/221:28:102
940799531,4cyclictest9024-21gzip20:35:493
940799531,4cyclictest9024-21gzip20:35:493
940799531,4cyclictest27711-21apt-get20:00:323
940799531,4cyclictest25736-21taskset00:38:493
940799531,41cyclictest5747-21taskset20:26:283
940799531,3cyclictest0-21swapper/322:56:553
940799531,35cyclictest18876-21cat21:05:183
940699536,4cyclictest7850irq/56-dwc_otg20:05:452
940699532,10cyclictest0-21swapper/223:32:302
940699531,5cyclictest20355-21ssh21:50:062
940799523,39cyclictest18188-21chrt19:34:553
940799521,39cyclictest0-21swapper/300:18:063
940699523,11cyclictest1822-21chrt22:46:022
940699522,5cyclictest8050irq/56-dwc_otg_21:18:532
940699521,6cyclictest8050irq/56-dwc_otg_20:00:372
940699521,6cyclictest25355-21sshd19:51:382
940699521,5cyclictest22868-21ssh23:12:412
940699521,11cyclictest0-21swapper/200:15:192
940699521,11cyclictest0-21swapper/200:15:192
940799512,37cyclictest0-21swapper/323:26:013
940799512,37cyclictest0-21swapper/323:26:013
940799511,4cyclictest20417-21cpu19:40:333
940799511,4cyclictest20417-21cpu19:40:333
940799511,40cyclictest25447-21chrt19:52:503
940799511,40cyclictest16146-21seq19:26:593
940799511,3cyclictest0-21swapper/319:57:383
940699519,4cyclictest0-21swapper/221:05:522
940699514,12cyclictest8050irq/56-dwc_otg_19:40:042
940699511,5cyclictest4907-21if_eth020:25:382
940699511,4cyclictest0-21swapper/222:29:382
940699511,2cyclictest0-21swapper/222:15:562
9406995111,4cyclictest13486-21if_wlan019:20:392
940699511,13cyclictest28657-21kworker/u8:221:34:402
940699511,11cyclictest22964-21ssh22:32:412
940699511,10cyclictest157762fschecks_time20:55:422
940799503,37cyclictest149642sleep320:52:313
940799502,32cyclictest0-21swapper/319:19:183
940799501,3cyclictest0-21swapper/320:33:523
940699502,3cyclictest8050irq/56-dwc_otg_23:10:032
940699501,9cyclictest7850irq/56-dwc_otg21:53:142
940699501,5cyclictest9673-21taskset20:39:082
940699501,5cyclictest9673-21taskset20:39:082
9405995010,25cyclictest0-21swapper/119:45:241
940699499,4cyclictest0-21swapper/219:30:402
940699491,8cyclictest0-21swapper/222:11:292
940699491,5cyclictest7850irq/56-dwc_otg00:37:252
940699491,3cyclictest7850irq/56-dwc_otg23:40:492
940599496,16cyclictest0-21swapper/121:15:331
940599495,10cyclictest0-21swapper/122:45:311
940599493,3cyclictest0-21swapper/123:15:371
940799482,36cyclictest167632chrt20:57:263
940799481,4cyclictest13339-21taskset20:49:483
940799481,31cyclictest0-21swapper/319:11:413
940699481,4cyclictest11868-21tr20:45:382
940699475,4cyclictest8050irq/56-dwc_otg_20:54:502
940599478,18cyclictest555-21rm21:25:281
940699463,4cyclictest8050irq/56-dwc_otg_20:31:242
940699461,9cyclictest0-21swapper/219:27:192
9406994611,5cyclictest107732chrt19:12:402
940699461,10cyclictest7850irq/56-dwc_otg20:21:192
940599457,25cyclictest0-21swapper/120:20:251
940599451,30cyclictest0-21swapper/119:30:301
940599447,26cyclictest0-21swapper/121:05:361
9405994413,22cyclictest0-21swapper/122:50:321
940599436,24cyclictest32297-21kworker/u8:300:05:361
940599431,6cyclictest21-21rcuc/119:55:381
9405994316,16cyclictest7850irq/56-dwc_otg22:00:451
940599427,20cyclictest32293-21ls20:10:471
940599425,4cyclictest8050irq/56-dwc_otg_22:55:301
940599423,23cyclictest0-21swapper/120:15:241
9405994218,15cyclictest0-21swapper/123:05:361
940599421,2cyclictest0-21swapper/121:10:301
9405994212,13cyclictest7850irq/56-dwc_otg21:55:471
901424223,13sleep00-21swapper/019:08:440
901424223,13sleep00-21swapper/019:08:440
940699411,5cyclictest25215-21snmpd21:01:302
940599419,13cyclictest221ktimersoftd/121:23:571
940599418,23cyclictest0-21swapper/120:05:381
9405994113,10cyclictest221ktimersoftd/123:56:471
9405994113,10cyclictest221ktimersoftd/123:56:471
201052410,2sleep10-21swapper/121:49:371
940599409,6cyclictest221ktimersoftd/123:20:341
940599408,16cyclictest8050irq/56-dwc_otg_19:15:421
940599407,23cyclictest0-21swapper/120:35:241
940599407,23cyclictest0-21swapper/120:35:241
940599407,13cyclictest8050irq/56-dwc_otg_22:25:181
940599405,22cyclictest221ktimersoftd/123:44:511
940599404,7cyclictest20621-21diskmemload00:35:311
940599404,17cyclictest21-21rcuc/123:31:161
9405994021,5cyclictest23-21ksoftirqd/119:10:481
9405994018,4cyclictest13450-21sh00:22:171
9405994017,13cyclictest7950irq/56-dwc_otg_22:40:331
9405994012,17cyclictest7850irq/56-dwc_otg22:06:211
113842400,2sleep10-21swapper/123:39:151
940599396,9cyclictest7850irq/56-dwc_otg19:25:291
940599396,3cyclictest0-21swapper/120:25:321
940599395,20cyclictest221ktimersoftd/121:37:121
9405993914,17cyclictest7850irq/56-dwc_otg00:00:331
9405993914,11cyclictest8050irq/56-dwc_otg_22:30:011
9405993912,7cyclictest8365-21ssh21:35:181
9405993912,12cyclictest8050irq/56-dwc_otg_23:50:181
940599387,21cyclictest0-21swapper/119:50:241
9405993832,4cyclictest7329-21ls20:30:461
9405993820,10cyclictest7950irq/56-dwc_otg_23:01:531
9405993819,9cyclictest7850irq/56-dwc_otg22:38:151
940599381,15cyclictest221ktimersoftd/100:27:041
940599378,7cyclictest221ktimersoftd/100:10:571
940599378,7cyclictest221ktimersoftd/100:10:571
940599377,21cyclictest0-21swapper/123:25:351
940599377,21cyclictest0-21swapper/123:25:351
9405993713,13cyclictest221ktimersoftd/122:13:481
940599367,20cyclictest0-21swapper/123:10:391
940599367,11cyclictest23-21ksoftirqd/100:16:171
9405993615,4cyclictest20856-21sh00:31:441
9405993613,15cyclictest7850irq/56-dwc_otg20:54:401
9405993610,11cyclictest8050irq/56-dwc_otg_23:55:191
940599354,21cyclictest7850irq/56-dwc_otg19:39:351
940599353,5cyclictest27705-21tr20:00:301
9405993525,7cyclictest21844-21sh19:45:181
9405993525,7cyclictest21844-21sh19:45:181
9405993515,8cyclictest7850irq/56-dwc_otg20:47:071
940599326,13cyclictest0-21swapper/120:55:361
940599324,8cyclictest7850irq/56-dwc_otg20:41:571
9405993111,13cyclictest172262chrt21:00:261
9405992911,8cyclictest0-21swapper/119:20:431
85112295,15sleep38645-21ls19:05:473
85112295,15sleep38645-21ls19:05:473
75942296,10sleep10-21swapper/119:05:331
75942296,10sleep10-21swapper/119:05:331
940699272,4cyclictest7850irq/56-dwc_otg19:15:332
91232273,17sleep20-21swapper/219:10:112
91232273,17sleep20-21swapper/219:10:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional