You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-08-01 - 20:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec

0, Linux 5.4.47-rt28-bsp-yocto-fsl-i.mx8mp-alpha1 (Profile)

Latency plot of shadow in rack #b, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q done
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackbslot5s.osadl.org (updated Wed Jul 21, 2021 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
51350799473,27cyclictest614732-21ssh23:21:412
51350799430,27cyclictest584078-21sh22:34:342
51350799411,36cyclictest638819-21apt-get00:00:022
51350799411,36cyclictest584763-21ssh22:35:182
51350799411,24cyclictest619746-21ssh23:29:552
513507994019,16cyclictest564933-21idleruntime-cro22:05:002
513507994019,16cyclictest564933-21idleruntime-cro22:05:002
513507994017,20cyclictest538447-21sh21:24:212
513507994014,23cyclictest559433-21sh21:56:212
51350799391,35cyclictest513999-21sshd19:13:342
513507993910,27cyclictest533855-21ssh21:17:162
51350799388,28cyclictest660748-21ssh00:38:182
51350799387,27cyclictest0-21swapper/221:53:582
51350799382,33cyclictest548315-21ssh21:39:272
51350799382,33cyclictest521641-21sshd20:12:192
513507993814,21cyclictest531942-21sh21:14:372
513507993814,21cyclictest531942-21sh21:14:372
51350799381,34cyclictest646016-21ssh00:12:032
51350799381,34cyclictest578959-21ssh22:26:262
51350799381,34cyclictest573217-21ssh22:17:402
51350799381,34cyclictest570258-21ssh22:13:082
51350799381,34cyclictest566199-21ssh22:06:472
51350799381,34cyclictest520440-21cron20:03:002
51350799381,34cyclictest516493-21sshd19:31:342
51350799381,33cyclictest643723-21ssh00:07:592
513507993813,22cyclictest578029-21latency_hist22:25:002
51350799381,21cyclictest600117-21ssh22:59:132
51350799380,22cyclictest544370-21ssh21:33:162
51350799377,27cyclictest0-21swapper/223:46:192
51350799372,32cyclictest552731-21ssh21:45:582
51350799371,33cyclictest656751-21ssh00:31:282
51350799371,33cyclictest653849-21ssh00:26:092
51350799371,33cyclictest652327-21sshd00:23:332
51350799371,33cyclictest636990-21ssh23:56:552
51350799371,33cyclictest634705-21ssh23:53:212
51350799371,33cyclictest628720-21ssh23:43:552
51350799371,33cyclictest623820-21ssh23:36:002
51350799371,33cyclictest605502-21ssh23:07:222
51350799371,33cyclictest601575-21ssh23:01:142
51350799371,33cyclictest594817-21ssh22:50:492
51350799371,33cyclictest588175-21ssh22:40:342
51350799371,33cyclictest549377-21ssh21:40:492
51350799371,33cyclictest549377-21ssh21:40:492
51350799371,33cyclictest539137-21ssh21:25:092
51350799371,33cyclictest539137-21ssh21:25:092
51350799371,33cyclictest527425-21cron20:58:002
51350799371,33cyclictest526669-21sshd20:51:332
51350799371,33cyclictest525658-21sshd20:44:332
51350799371,33cyclictest523620-21cron20:28:002
51350799371,33cyclictest522864-21sshd20:21:332
51350799371,33cyclictest522463-21sshd20:19:332
51350799371,33cyclictest519791-21cron19:58:002
51350799371,33cyclictest519158-21cron19:53:002
51350799371,33cyclictest514492-21sshd19:15:342
51350799370,34cyclictest608274-21ssh23:11:382
51350799370,34cyclictest526040-21sshd20:46:332
51350799370,34cyclictest520867-21sshd20:05:332
51350799370,34cyclictest518404-21sshd19:46:332
51350799368,24cyclictest0-21swapper/220:32:362
51350799361,32cyclictest729-21snmpd21:08:142
51350799361,32cyclictest647868-21ssh00:15:102
51350799361,32cyclictest647868-21ssh00:15:102
51350799361,32cyclictest592202-21ssh22:46:522
51350799361,32cyclictest527870-21sshd21:00:332
51350799361,32cyclictest524847-21sshd20:37:332
51350799361,32cyclictest517290-21sshd19:38:332
51350799361,32cyclictest517290-21sshd19:38:332
513498993526,5cyclictest650322-21cron00:20:000
513498993526,5cyclictest650322-21cron00:20:000
513503993426,5cyclictest574633-21idleruntime-cro22:20:001
51350799331,29cyclictest729-21snmpd19:42:002
51350799331,29cyclictest515316-21sshd19:22:332
51350799321,28cyclictest729-21snmpd19:27:392
513498993020,5cyclictest528870-21cron21:10:010
513512992920,6cyclictest574657-21basename22:20:003
51349899291,22cyclictest0-21swapper/022:30:000
513498992816,7cyclictest603867-21munin-plugin-st23:05:000
513498992812,9cyclictest0-21swapper/022:36:090
51349899281,19cyclictest0-21swapper/023:20:150
513498992811,14cyclictest543396-21seq21:31:400
51349899280,4cyclictest235-21kpktgend_000:35:000
513512992719,4cyclictest1-21systemd21:07:313
51350399279,3cyclictest111rcu_preempt00:05:011
513503992722,3cyclictest20-21ksoftirqd/100:15:041
513503992722,3cyclictest20-21ksoftirqd/100:15:041
513503992720,4cyclictest661715-21cat00:40:001
513503992718,5cyclictest545422-21cron21:35:001
513498992718,5cyclictest516152-21sh19:30:010
51349899271,2cyclictest0-21swapper/021:55:030
51349899271,2cyclictest0-21swapper/000:03:410
51349899271,19cyclictest0-21swapper/000:11:590
513512992618,4cyclictest514367-21latency_hist19:15:013
51350399261,4cyclictest0-21swapper/122:30:001
51350399260,5cyclictest0-21swapper/123:32:141
51349899266,4cyclictest111rcu_preempt19:40:000
51349899266,4cyclictest111rcu_preempt19:40:000
51349899264,17cyclictest0-21swapper/022:25:000
51349899263,5cyclictest514881-21munin-run19:20:000
513498992618,5cyclictest536102-21seq21:20:290
51349899261,3cyclictest0-21swapper/023:27:090
51349899261,2cyclictest111rcu_preempt21:50:270
51349899261,2cyclictest0-21swapper/023:48:350
51349899261,2cyclictest0-21swapper/022:12:330
51349899261,19cyclictest0-21swapper/022:30:420
51349899261,18cyclictest0-21swapper/021:28:320
51349899261,18cyclictest0-21swapper/021:28:310
51349899261,17cyclictest0-21swapper/020:00:010
513512992520,3cyclictest542197-21sed21:30:013
513512992520,3cyclictest542197-21sed21:30:003
513512992518,4cyclictest519324-21cron19:55:003
513512992516,6cyclictest545437-21basename21:35:003
51351299251,3cyclictest0-21swapper/323:01:363
51350399257,4cyclictest111rcu_preempt21:25:011
513503992517,5cyclictest532378-21cat21:15:001
513503992517,5cyclictest532378-21cat21:15:001
513503992516,5cyclictest568158-21basename22:10:001
51350399251,4cyclictest0-21swapper/120:45:011
513503992511,4cyclictest111rcu_preempt00:15:001
51349899259,10cyclictest0-21swapper/000:39:470
513498992520,3cyclictest25650irq/34-mmc123:00:000
513498992516,5cyclictest525695-21cron20:45:020
51349899251,2cyclictest0-21swapper/022:49:490
51349899251,2cyclictest0-21swapper/021:11:510
51349899251,2cyclictest0-21swapper/021:11:510
51349899251,21cyclictest533421-21ssh21:16:310
51349899251,18cyclictest0-21swapper/022:44:560
51349899251,18cyclictest0-21swapper/000:27:340
51349899250,3cyclictest0-21swapper/023:05:540
513512992416,4cyclictest358-21dbus-daemon19:57:263
51351299241,3cyclictest0-21swapper/323:59:393
513503992419,3cyclictest20-21ksoftirqd/100:27:311
513503992418,3cyclictest644831-21latency_hist00:10:001
513503992417,4cyclictest20-21ksoftirqd/121:35:541
513503992416,4cyclictest518701-21idleruntime-cro19:50:011
51350399241,18cyclictest525043-21cron20:40:011
51349899247,6cyclictest9-21ksoftirqd/023:19:590
51349899247,11cyclictest111rcu_preempt21:47:060
513498992414,6cyclictest514204-21auditctl19:15:010
51349899241,2cyclictest111rcu_preempt22:50:270
51349899241,2cyclictest0-21swapper/023:31:300
51349899241,2cyclictest0-21swapper/021:03:240
51349899241,2cyclictest0-21swapper/000:23:110
513498992410,8cyclictest0-21swapper/022:09:020
51349899240,2cyclictest111rcu_preempt22:02:280
51349899240,2cyclictest111rcu_preempt22:02:270
51349899240,2cyclictest111rcu_preempt21:35:430
513512992317,4cyclictest558548-21cut21:55:023
513512992316,5cyclictest526976-21basename20:55:003
513512992315,5cyclictest650328-21sh00:20:003
513512992315,5cyclictest650328-21sh00:20:003
513512992315,4cyclictest561664-21sendmail22:00:003
51350399235,3cyclictest111rcu_preempt21:10:001
51350399232,3cyclictest111rcu_preempt23:19:581
51350399231,4cyclictest0-21swapper/121:46:291
513503992314,5cyclictest0-21swapper/122:02:371
513503992314,5cyclictest0-21swapper/122:02:361
51350399231,3cyclictest111rcu_preempt23:04:271
51349899237,9cyclictest496691-1kworker/0:0H19:50:010
51349899237,10cyclictest0-21swapper/000:09:520
51349899233,5cyclictest9-21ksoftirqd/020:40:000
513498992318,3cyclictest34450irq/42-eth020:50:330
513498992317,4cyclictest607729-21seq23:10:430
51349899230,2cyclictest111rcu_preempt23:44:520
51349899230,2cyclictest111rcu_preempt20:48:350
51351299229,10cyclictest661659-21sendmail00:40:013
513512992216,4cyclictest552110-21date21:45:013
513512992216,4cyclictest552110-21date21:45:013
513512992216,3cyclictest569270-21sh22:11:303
513512992215,5cyclictest527599-21cat21:00:003
513512992215,4cyclictest34-21ksoftirqd/322:55:333
513512992214,4cyclictest525093-21latency_hist20:40:003
51351299220,3cyclictest111rcu_preempt23:25:003
51350399226,4cyclictest111rcu_preempt00:00:001
513503992216,3cyclictest632891-21sh23:50:161
51350399221,5cyclictest517420-21sendmail19:40:001
51350399221,5cyclictest517420-21sendmail19:40:001
51350399221,3cyclictest0-21swapper/122:47:271
513503992212,6cyclictest516147-21cron19:30:011
51350399220,3cyclictest0-21swapper/122:41:361
513498992218,2cyclictest25650irq/34-mmc120:10:010
513498992216,4cyclictest527700-21sed21:00:000
513498992215,5cyclictest515686-21sed19:25:010
51349899221,4cyclictest0-21swapper/020:13:140
51351299214,3cyclictest6422552ssh00:05:103
513512992116,3cyclictest5880892sleep322:40:273
513512992116,3cyclictest577672-21sh22:24:393
513512992116,3cyclictest34-21ksoftirqd/320:25:013
513512992115,4cyclictest34-21ksoftirqd/323:12:313
513512992115,4cyclictest34-21ksoftirqd/321:13:413
513512992115,4cyclictest34-21ksoftirqd/321:13:413
513512992115,4cyclictest34-21ksoftirqd/321:04:353
513512992115,3cyclictest657367-21sh00:32:333
513512992115,3cyclictest645519-21sh00:11:063
513512992115,3cyclictest642131-21latency_hist00:05:003
513512992115,3cyclictest631971-21sh23:49:033
513512992115,3cyclictest592183-21sh22:46:493
513512992114,4cyclictest525713-21basename20:45:023
51351299211,3cyclictest0-21swapper/323:52:313
51351299211,3cyclictest0-21swapper/321:45:193
51350399216,3cyclictest111rcu_preempt23:47:561
51350399214,4cyclictest111rcu_preempt23:00:011
51350399214,3cyclictest111rcu_preempt22:34:531
513503992116,3cyclictest627086-21sh23:41:091
513503992116,3cyclictest624743-21sh23:37:361
513503992116,3cyclictest613969-21sh23:20:181
513503992116,3cyclictest561587-21sh21:59:531
513503992116,3cyclictest551662-21sh21:44:351
513503992116,3cyclictest551662-21sh21:44:341
513503992116,3cyclictest532824-21sh21:15:341
513503992115,4cyclictest558643-21sed21:55:011
513503992115,4cyclictest20-21ksoftirqd/120:10:011
513503992115,3cyclictest656033-21sh00:30:041
513503992115,3cyclictest575737-21sh22:21:281
513503992114,4cyclictest520191-21cut20:00:011
513503992112,6cyclictest526961-21cron20:55:001
51350399210,5cyclictest605100-21ssh23:06:431
513498992115,4cyclictest9-21ksoftirqd/022:16:110
51349899211,4cyclictest524427-21munin-run20:35:000
513512992015,3cyclictest623822-21sh23:36:013
513512992015,3cyclictest34-21ksoftirqd/323:40:273
513512992015,3cyclictest34-21ksoftirqd/323:27:573
513512992015,3cyclictest34-21ksoftirqd/322:55:003
513512992014,4cyclictest34-21ksoftirqd/322:09:253
513512992014,3cyclictest651860-21sh00:22:403
51350399205,3cyclictest111rcu_preempt20:05:001
51350399203,4cyclictest0-21swapper/120:34:261
51350399201,5cyclictest0-21swapper/120:29:021
51350399200,3cyclictest0-21swapper/122:10:481
513498992015,3cyclictest739-21runrttasks20:27:050
51349899201,1cyclictest0-21swapper/019:41:390
51349899201,13cyclictest0-21swapper/019:32:090
51349899200,4cyclictest520604-21cron20:05:000
51351299191,4cyclictest514877-21ls19:20:003
513512991914,3cyclictest653881-21sh00:26:123
513512991914,3cyclictest579283-21cron22:27:003
513512991913,4cyclictest34-21ksoftirqd/322:32:493
513512991913,4cyclictest34-21ksoftirqd/321:20:023
513512991913,4cyclictest34-21ksoftirqd/321:18:433
513512991913,4cyclictest34-21ksoftirqd/319:45:003
513512991912,4cyclictest524418-21sh20:35:003
51351299191,15cyclictest522500-21cron20:20:003
51350399197,3cyclictest0-21swapper/120:45:591
513503991914,3cyclictest594930-21sh22:51:001
513503991914,3cyclictest522052-21latency_hist20:15:011
513503991914,3cyclictest20-21ksoftirqd/123:10:201
513503991913,4cyclictest527397-21seq20:57:381
513503991912,4cyclictest523177-21basename20:25:011
51349899191,4cyclictest111rcu_preempt19:55:000
51349899191,14cyclictest0-21swapper/020:23:160
51349899190,3cyclictest522502-21cron20:20:000
513512991812,4cyclictest520707-21date20:05:003
513512991811,4cyclictest515666-21latency_hist19:25:003
513512991810,4cyclictest0-21swapper/319:30:013
51350399182,4cyclictest20-21ksoftirqd/119:52:251
51350399181,3cyclictest111rcu_preempt21:05:021
513503991813,3cyclictest522520-21latency_hist20:20:001
513503991812,4cyclictest515338-21seq19:22:491
51351299179,5cyclictest300-21systemd-journal20:07:263
513512991712,3cyclictest739-21runrttasks19:37:323
513512991712,3cyclictest739-21runrttasks19:37:323
513512991711,4cyclictest516833-21sed19:35:013
51350399173,3cyclictest111rcu_preempt19:31:341
51350399171,3cyclictest111rcu_preempt19:45:001
513512991611,3cyclictest518699-21latency_hist19:50:013
513512991510,3cyclictest739-21runrttasks20:14:243
51351299149,3cyclictest739-21runrttasks20:26:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional