You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 15:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6s.osadl.org (updated Fri Apr 26, 2024 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32725911630,4ptp4l241ktimersoftd/100:13:141
1292421080,8sleep02491099cyclictest03:02:370
675121010,8sleep12491199cyclictest02:02:581
32725911000,1ptp4l241ktimersoftd/103:38:371
32725911000,1ptp4l241ktimersoftd/103:38:371
3272591990,1ptp4l241ktimersoftd/100:17:561
3272591950,1ptp4l241ktimersoftd/104:00:051
3272591950,12ptp4l241ktimersoftd/104:18:291
311962910,8sleep02491099cyclictest05:38:090
211982910,7sleep12491199cyclictest05:23:521
3272591850,1ptp4l241ktimersoftd/103:57:131
3272591810,2ptp4l241ktimersoftd/102:47:121
3272591800,1ptp4l241ktimersoftd/104:07:531
3272591790,1ptp4l241ktimersoftd/104:52:531
3272591790,1ptp4l241ktimersoftd/104:52:531
3272591790,1ptp4l241ktimersoftd/103:25:581
3272591790,1ptp4l241ktimersoftd/100:39:071
3272591720,3ptp4l28712-21kworker/1:004:13:301
3272591720,19ptp4l18245-21kworker/1:103:36:161
3272591710,3ptp4l3662-21kworker/1:204:50:411
3272591710,3ptp4l11845-21kworker/1:201:00:561
3272591710,20ptp4l3662-21kworker/1:205:18:201
3272591710,1ptp4l241ktimersoftd/105:42:291
242242692,55sleep024336-21unixbench_multi00:12:580
3272591660,1ptp4l241ktimersoftd/105:35:141
3272591650,1ptp4l241ktimersoftd/105:02:041
3272591640,1ptp4l241ktimersoftd/103:07:241
3272591620,1ptp4l241ktimersoftd/104:24:241
3272591610,1ptp4l241ktimersoftd/105:05:381
3272591590,4ptp4l18245-21kworker/1:103:47:401
3272591580,1ptp4l241ktimersoftd/103:15:051
3272591560,1ptp4l241ktimersoftd/102:38:231
3272591540,1ptp4l241ktimersoftd/104:05:161
3272591530,1ptp4l241ktimersoftd/102:24:211
3272591520,3ptp4l3662-21kworker/1:204:43:371
3272591520,1ptp4l241ktimersoftd/100:33:001
2491199525,4cyclictest121rcu_preempt01:12:521
3272591510,1ptp4l241ktimersoftd/101:17:511
3272591500,7ptp4l241ktimersoftd/103:27:471
3272591500,3ptp4l9306-21kworker/1:002:11:021
3272591500,1ptp4l241ktimersoftd/104:38:381
3272591500,1ptp4l241ktimersoftd/103:07:331
3272591500,1ptp4l241ktimersoftd/102:49:541
3272591500,1ptp4l241ktimersoftd/102:19:151
3272591490,1ptp4l241ktimersoftd/105:39:041
3272591490,1ptp4l241ktimersoftd/105:14:531
3272591490,1ptp4l241ktimersoftd/105:09:091
3272591490,1ptp4l241ktimersoftd/104:34:591
3272591490,1ptp4l241ktimersoftd/102:58:121
3272591490,1ptp4l241ktimersoftd/102:55:471
3272591490,1ptp4l241ktimersoftd/102:36:421
3272591490,1ptp4l241ktimersoftd/102:28:531
3272591480,1ptp4l241ktimersoftd/105:28:451
3272591480,1ptp4l241ktimersoftd/101:27:571
3272591480,1ptp4l241ktimersoftd/101:03:011
3272591480,1ptp4l241ktimersoftd/101:03:011
3272591480,1ptp4l241ktimersoftd/100:52:261
130442480,6sleep02491099cyclictest02:17:510
3272591470,1ptp4l241ktimersoftd/104:30:441
3272591470,1ptp4l241ktimersoftd/102:01:491
3272591470,1ptp4l241ktimersoftd/101:37:571
3272591470,1ptp4l241ktimersoftd/101:08:051
3272591460,1ptp4l241ktimersoftd/103:45:431
3272591460,1ptp4l241ktimersoftd/102:16:511
3272591460,1ptp4l241ktimersoftd/101:42:541
3272591450,1ptp4l241ktimersoftd/100:50:181
3272591440,1ptp4l241ktimersoftd/100:30:001
3272591430,1ptp4l241ktimersoftd/101:47:521
3272591430,1ptp4l241ktimersoftd/101:33:311
3272591420,1ptp4l241ktimersoftd/103:21:171
3272591420,1ptp4l241ktimersoftd/100:26:081
306382410,3sleep00-21swapper/000:27:470
2491099415,4cyclictest121rcu_preempt02:42:180
2491099413,5cyclictest121rcu_preempt04:43:020
3272591400,1ptp4l241ktimersoftd/101:55:181
2491099405,4cyclictest121rcu_preempt05:07:180
24910994012,25cyclictest9-21ksoftirqd/000:56:330
2491199391,16cyclictest121rcu_preempt00:42:411
2491099391,33cyclictest42650irq/98-enp4s0-t03:23:360
314542380,7sleep02491099cyclictest03:27:400
2491099386,9cyclictest121rcu_preempt03:01:210
2491099385,10cyclictest121rcu_preempt03:32:300
2491099381,6cyclictest26925-21ssh03:21:310
2491099374,10cyclictest121rcu_preempt04:05:360
2491099372,9cyclictest121rcu_preempt05:12:320
2491099372,4cyclictest121rcu_preempt05:10:460
2491099372,4cyclictest121rcu_preempt02:51:400
2491099364,9cyclictest121rcu_preempt04:52:170
24910993626,6cyclictest9-21ksoftirqd/002:04:570
2491099362,10cyclictest121rcu_preempt03:44:540
24910993613,18cyclictest25259-21basename01:32:320
301162350,3sleep00-21swapper/001:42:440
24910993410,19cyclictest10832-21apt-get04:27:380
2491099332,26cyclictest994-21snmp_o5powerctl04:12:580
2491099332,26cyclictest6610-21snmp_o5powerctl02:53:010
2491099332,10cyclictest22363-21snmp_o5powerctl03:57:590
24910993313,6cyclictest9-21ksoftirqd/002:24:200
2491099330,30cyclictest42450irq/96-enp4s0-r03:39:430
2491099330,30cyclictest42450irq/96-enp4s0-r03:39:430
3272591320,1ptp4l241ktimersoftd/101:22:341
2491099325,19cyclictest15886-21apt-get05:17:380
2491099323,22cyclictest12539-21apt-get01:02:310
2491099323,22cyclictest12539-21apt-get01:02:310
24910993222,6cyclictest9-21ksoftirqd/001:59:250
24910993221,6cyclictest9-21ksoftirqd/004:34:400
24910993221,6cyclictest9-21ksoftirqd/003:08:590
24910993221,6cyclictest9-21ksoftirqd/000:35:200
24910993217,9cyclictest1360-21apt-get01:52:350
2491099318,12cyclictest9-21ksoftirqd/004:40:150
24910993122,5cyclictest9-21ksoftirqd/005:26:010
24910993121,6cyclictest9-21ksoftirqd/001:50:390
24910993121,5cyclictest9-21ksoftirqd/001:23:370
24910993121,5cyclictest9-21ksoftirqd/001:15:410
24910993120,8cyclictest9-21ksoftirqd/003:12:470
24910993118,7cyclictest28663-21/usr/sbin/munin00:22:460
2491099311,19cyclictest5590-21runrttasks00:45:290
2491099311,12cyclictest0-21swapper/003:57:110
2491099308,18cyclictest27748-21timerwakeupswit05:33:070
2491099306,15cyclictest27440-21apt-get01:37:370
2491099302,8cyclictest8877-21snmp_o5powerctl02:07:560
2491099302,7cyclictest31953-21ssh04:55:000
2491099302,7cyclictest31953-21ssh04:55:000
24910993021,5cyclictest9-21ksoftirqd/001:10:550
2491099301,8cyclictest15483-21ssh03:48:140
24910993018,8cyclictest9-21ksoftirqd/004:07:560
2491099301,4cyclictest121rcu_preempt05:46:350
2491099301,23cyclictest9523-21ssh04:25:080
2491099297,18cyclictest1441-21irqrtprio04:57:490
2491099297,16cyclictest24517-21ssh05:28:200
2491099297,14cyclictest6035-21apt-get00:47:340
24910992918,8cyclictest9-21ksoftirqd/002:42:540
24910992918,8cyclictest9-21ksoftirqd/000:37:520
24910992918,7cyclictest9-21ksoftirqd/002:17:150
2491099291,6cyclictest19656-21diskstats02:27:400
2491099291,23cyclictest5851-21ssh04:20:150
2491099291,23cyclictest24367-21snmp_o5powerctl02:32:580
2491099291,23cyclictest11180-21/usr/sbin/munin00:57:500
2491099286,13cyclictest18971-21apt-get01:17:350
2491099282,20cyclictest25307-21df00:17:390
24910992818,6cyclictest9-21ksoftirqd/001:29:500
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional