You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-09 - 21:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot7s.osadl.org (updated Mon Dec 09, 2024 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
238222770,0sleep20-21swapper/209:49:492
183832560,3sleep1224-21systemd-journal10:10:291
1805023630,2sleep00-21swapper/007:05:560
18465992825,2cyclictest3659-21apt12:15:140
1833822621,1sleep30-21swapper/307:09:393
1846699251,17cyclictest141rcu_preempt12:26:451
1846999241,22cyclictest7744-21snmpd11:27:413
1846999241,22cyclictest7744-21snmpd11:27:403
1846699248,8cyclictest224-21systemd-journal11:13:171
18466992420,1cyclictest224-21systemd-journal11:33:371
1846599249,9cyclictest558-21lldpd07:24:590
1836422422,1sleep10-21swapper/107:09:581
18469992320,2cyclictest39-21ksoftirqd/309:50:213
1846999230,23cyclictest0-21swapper/312:12:213
1846899237,12cyclictest224-21systemd-journal09:29:012
1846899230,21cyclictest0-21swapper/210:34:552
1846999225,10cyclictest11280-21diskmemload10:45:123
1846899225,7cyclictest502-21rs:main2
1846599220,1cyclictest0-21swapper/009:20:110
18469992118,2cyclictest39-21ksoftirqd/311:22:553
18469992118,2cyclictest39-21ksoftirqd/311:15:133
18469992111,6cyclictest39-21ksoftirqd/311:59:223
1846699210,2cyclictest0-21swapper/112:36:011
1846599215,7cyclictest7744-21snmpd11:27:200
1846599215,7cyclictest7744-21snmpd11:27:190
1846599211,8cyclictest224-21systemd-journal10:53:010
18465992112,7cyclictest500-21in:imuxsock12:04:510
1846999202,11cyclictest224-21systemd-journal10:56:233
18469992018,2cyclictest39-21ksoftirqd/309:50:003
18469992017,2cyclictest39-21ksoftirqd/310:40:013
18469992016,2cyclictest39-21ksoftirqd/309:29:163
18469992015,2cyclictest39-21ksoftirqd/310:26:303
18469992013,1cyclictest39-21ksoftirqd/311:54:513
18469992013,1cyclictest39-21ksoftirqd/310:07:083
1846699208,1cyclictest141rcu_preempt09:00:541
1846699203,8cyclictest224-21systemd-journal12:33:301
1846699202,9cyclictest224-21systemd-journal11:24:451
18466992019,1cyclictest0-21swapper/111:02:211
18466992012,2cyclictest224-21systemd-journal11:19:061
1846699201,11cyclictest224-21systemd-journal09:36:591
18466992010,3cyclictest224-21systemd-journal10:45:351
1846599206,10cyclictest20057-21apt-get12:05:130
1846599200,1cyclictest0-21swapper/011:35:220
1846999194,14cyclictest558-21lldpd09:24:123
1846999193,3cyclictest224-21systemd-journal10:32:103
18469991912,2cyclictest39-21ksoftirqd/307:10:223
1846899192,1cyclictest558-21lldpd12:04:402
18468991917,1cyclictest37850irq/131-snd_hda10:57:452
18468991913,4cyclictest500-21in:imuxsock12:35:272
1846899190,3cyclictest0-21swapper/211:52:562
1846699198,6cyclictest224-21systemd-journal10:35:131
1846699198,4cyclictest224-21systemd-journal11:49:281
1846699195,5cyclictest224-21systemd-journal11:08:091
1846699194,2cyclictest141rcu_preempt10:26:191
1846699190,6cyclictest224-21systemd-journal10:15:241
1846699190,6cyclictest224-21systemd-journal10:15:231
18465991916,2cyclictest558-21lldpd10:21:090
18465991911,5cyclictest558-21lldpd10:42:310
1846999187,5cyclictest558-21lldpd12:18:513
1846999187,3cyclictest7744-21snmpd11:10:223
1846999186,1cyclictest141rcu_preempt11:30:113
1846999183,7cyclictest0-21swapper/309:20:003
18469991815,2cyclictest39-21ksoftirqd/311:45:273
18469991815,1cyclictest39-21ksoftirqd/312:05:573
1846999180,2cyclictest0-21swapper/311:04:013
1846899186,2cyclictest0-21swapper/210:40:212
1846899185,3cyclictest224-21systemd-journal10:20:152
1846899181,1cyclictest19313-21ssh11:22:242
1846699185,9cyclictest7744-21snmpd10:20:101
1846699185,5cyclictest224-21systemd-journal09:22:591
1846699183,6cyclictest224-21systemd-journal09:55:271
1846699181,14cyclictest11280-21diskmemload11:42:041
18466991810,5cyclictest224-21systemd-journal12:12:251
1846699180,10cyclictest141rcu_preempt09:30:021
1846599187,6cyclictest12698-21munin-run08:05:010
1846599186,7cyclictest500-21in:imuxsock11:40:150
18465991816,1cyclictest7744-21snmpd09:43:590
18465991813,2cyclictest224-21systemd-journal11:00:240
18465991812,5cyclictest18460-21cyclictest09:34:120
18465991810,5cyclictest7744-21snmpd09:58:350
1846999179,5cyclictest39-21ksoftirqd/308:50:143
1846999174,5cyclictest558-21lldpd08:10:163
1846999174,4cyclictest224-21systemd-journal12:29:063
1846999172,10cyclictest39-21ksoftirqd/308:05:233
1846999171,5cyclictest381rcuc/307:45:163
18469991715,1cyclictest39-21ksoftirqd/310:00:003
18469991715,1cyclictest39-21ksoftirqd/307:55:153
18469991714,2cyclictest39-21ksoftirqd/312:30:093
18469991714,2cyclictest39-21ksoftirqd/308:20:133
18469991712,2cyclictest31037-21basename11:09:593
1846899174,4cyclictest17689-21apache_volume09:15:142
1846899173,8cyclictest224-21systemd-journal07:27:082
1846899172,14cyclictest7744-21snmpd10:52:422
1846699177,2cyclictest141rcu_preempt10:06:011
1846699175,5cyclictest224-21systemd-journal12:04:391
1846699174,6cyclictest224-21systemd-journal11:25:401
1846699174,6cyclictest224-21systemd-journal11:25:391
1846699174,4cyclictest141rcu_preempt11:38:331
1846699173,8cyclictest224-21systemd-journal08:30:191
1846699172,6cyclictest224-21systemd-journal11:51:401
1846699172,5cyclictest224-21systemd-journal09:52:431
1846699171,6cyclictest224-21systemd-journal08:39:321
18466991712,2cyclictest224-21systemd-journal12:20:501
1846599177,4cyclictest500-21in:imuxsock09:26:000
1846599175,6cyclictest224-21systemd-journal09:50:130
1846599174,2cyclictest224-21systemd-journal10:28:120
1846599172,4cyclictest7744-21snmpd09:49:500
18465991713,3cyclictest500-21in:imuxsock11:13:170
18465991711,2cyclictest500-21in:imuxsock11:18:130
1846999168,3cyclictest4905-21wget11:35:183
1846999165,7cyclictest11280-21diskmemload10:18:163
1846999165,7cyclictest11280-21diskmemload10:18:163
1846999162,8cyclictest224-21systemd-journal09:30:453
1846999162,2cyclictest141rcu_preempt09:40:173
1846999161,4cyclictest141rcu_preempt12:02:123
18469991614,1cyclictest381rcuc/310:22:243
18469991613,2cyclictest39-21ksoftirqd/308:20:013
1846899167,3cyclictest558-21lldpd11:38:492
1846899163,1cyclictest7744-21snmpd09:36:412
1846899163,12cyclictest558-21lldpd08:40:142
1846899162,7cyclictest224-21systemd-journal08:00:012
1846899161,8cyclictest224-21systemd-journal11:29:042
1846899161,8cyclictest224-21systemd-journal11:29:032
1846899161,1cyclictest11280-21diskmemload10:29:362
1846899161,14cyclictest0-21swapper/209:40:182
1846899161,12cyclictest500-21in:imuxsock10:35:572
1846899160,14cyclictest558-21lldpd11:06:192
1846699167,2cyclictest224-21systemd-journal09:26:201
1846699165,3cyclictest224-21systemd-journal12:16:271
1846699164,1cyclictest141rcu_preempt10:57:331
1846699163,8cyclictest224-21systemd-journal11:55:551
1846699163,3cyclictest224-21systemd-journal08:07:581
1846699162,6cyclictest224-21systemd-journal10:51:141
1846699161,14cyclictest558-21lldpd10:00:141
1846699160,1cyclictest141rcu_preempt09:19:291
1846699160,1cyclictest141rcu_preempt07:41:161
1846599168,5cyclictest7744-21snmpd09:03:390
1846599165,3cyclictest224-21systemd-journal09:15:410
1846599163,4cyclictest500-21in:imuxsock10:07:020
1846599163,3cyclictest141rcu_preempt10:35:010
18465991614,1cyclictest558-21lldpd10:01:230
18465991614,1cyclictest0-21swapper/010:14:370
18465991613,1cyclictest502-21rs:main0
18465991612,1cyclictest0-21swapper/010:34:100
18465991611,1cyclictest502-21rs:main0
1846999159,3cyclictest224-21systemd-journal07:25:173
1846999158,6cyclictest39-21ksoftirqd/309:36:183
1846999155,4cyclictest558-21lldpd10:40:223
1846999154,4cyclictest224-21systemd-journal10:13:473
1846999152,6cyclictest25505-21diskstats08:30:203
1846999152,5cyclictest224-21systemd-journal10:50:173
18469991513,2cyclictest39-21ksoftirqd/310:00:123
18469991512,2cyclictest558-21lldpd12:20:523
1846999150,2cyclictest0-21swapper/307:20:123
1846899159,5cyclictest15071-21ssh11:40:512
1846899156,5cyclictest558-21lldpd12:15:202
1846899155,9cyclictest7744-21snmpd12:25:402
1846899155,4cyclictest224-21systemd-journal09:10:292
1846899155,4cyclictest224-21systemd-journal09:10:282
1846899153,2cyclictest11280-21diskmemload12:14:492
1846899152,11cyclictest7744-21snmpd12:20:042
18468991513,1cyclictest37850irq/131-snd_hda08:04:492
18468991510,5cyclictest37850irq/131-snd_hda11:47:512
18468991510,4cyclictest37850irq/131-snd_hda10:00:222
18468991510,4cyclictest13073-21basename08:05:152
1846899150,5cyclictest224-21systemd-journal08:10:292
1846899150,15cyclictest0-21swapper/212:31:152
1846899150,14cyclictest0-21swapper/210:15:062
1846899150,14cyclictest0-21swapper/210:15:062
1846699159,1cyclictest141rcu_preempt09:09:011
1846699157,5cyclictest224-21systemd-journal09:11:001
1846699157,5cyclictest224-21systemd-journal09:10:591
1846699155,5cyclictest224-21systemd-journal10:34:421
1846699155,1cyclictest0-21swapper/112:07:431
1846699150,7cyclictest141rcu_preempt08:40:121
1846699150,1cyclictest141rcu_preempt08:00:201
1846599156,6cyclictest500-21in:imuxsock11:32:180
1846599156,6cyclictest500-21in:imuxsock07:15:170
1846599152,5cyclictest7744-21snmpd12:27:550
1846599152,2cyclictest141rcu_preempt11:51:380
18465991513,1cyclictest32074-21apt-get08:45:150
1846599151,2cyclictest558-21lldpd12:39:180
18465991510,4cyclictest13-21ksoftirqd/011:46:500
1846999146,5cyclictest39-21ksoftirqd/312:36:143
1846999146,3cyclictest224-21systemd-journal08:28:103
1846999142,7cyclictest224-21systemd-journal08:56:413
1846899147,6cyclictest500-21in:imuxsock09:30:412
1846899147,2cyclictest224-21systemd-journal11:55:322
1846899145,7cyclictest10022-21apt-get10:05:022
1846899144,5cyclictest224-21systemd-journal09:58:352
1846899144,5cyclictest224-21systemd-journal09:04:092
1846899144,4cyclictest11280-21diskmemload11:15:052
1846899144,2cyclictest224-21systemd-journal09:08:522
18468991410,3cyclictest3345-21wc08:50:242
18468991410,2cyclictest0-21swapper/212:08:072
18468991410,2cyclictest0-21swapper/208:30:262
1846899140,6cyclictest224-21systemd-journal11:03:342
1846899140,4cyclictest224-21systemd-journal11:10:012
1846699148,1cyclictest141rcu_preempt08:19:281
1846699145,7cyclictest500-21in:imuxsock07:25:221
1846699141,2cyclictest224-21systemd-journal09:43:081
1846699141,1cyclictest11280-21diskmemload10:40:171
1846599149,5cyclictest25413-21apache210:58:370
1846599147,2cyclictest224-21systemd-journal08:21:550
1846599142,7cyclictest5597-21apt-get07:50:150
1846599141,12cyclictest558-21lldpd12:33:170
18465991411,2cyclictest500-21in:imuxsock09:05:230
18465991411,2cyclictest2375-21ssh10:48:210
1846599141,10cyclictest11280-21diskmemload09:39:530
1846599140,4cyclictest558-21lldpd11:56:550
1846999139,3cyclictest549-21uname08:45:203
1846999138,4cyclictest27375-21aten2_r7power_p08:35:133
1846999138,2cyclictest558-21lldpd11:40:453
1846999137,4cyclictest39-21ksoftirqd/307:40:123
1846999134,5cyclictest224-21systemd-journal07:32:243
1846999133,4cyclictest224-21systemd-journal07:15:413
18469991310,2cyclictest31152-21expr07:35:163
18469991310,2cyclictest11625-21sh09:10:093
18469991310,2cyclictest11625-21sh09:10:083
1846899139,3cyclictest24845-21ssh09:50:192
1846899137,2cyclictest224-21systemd-journal08:35:222
1846899135,3cyclictest29085-21/usr/sbin/munin11:30:112
1846899133,7cyclictest7744-21snmpd07:35:232
1846899133,6cyclictest224-21systemd-journal08:57:342
18468991310,2cyclictest30595-21cat07:34:592
18468991310,2cyclictest19627-21sh10:11:432
1846899130,12cyclictest0-21swapper/209:23:052
1846699139,1cyclictest141rcu_preempt09:45:291
1846699136,2cyclictest224-21systemd-journal07:52:141
1846699133,6cyclictest0-21swapper/108:45:151
1846699131,6cyclictest141rcu_preempt07:21:281
18466991310,2cyclictest5155-21sed08:55:191
18466991310,2cyclictest500-21in:imuxsock07:19:341
18466991310,2cyclictest21441-21wc08:20:271
18466991310,2cyclictest18891-21grep07:10:151
18466991310,2cyclictest10074-21taskset07:57:251
1846699130,8cyclictest141rcu_preempt08:10:461
1846699130,6cyclictest141rcu_preempt08:51:291
1846599134,4cyclictest224-21systemd-journal08:17:580
1846599134,3cyclictest25888-21latency08:30:230
1846599134,2cyclictest224-21systemd-journal07:55:170
1846599133,4cyclictest224-21systemd-journal08:28:540
1846599132,2cyclictest22797-21apache_accesses10:15:120
1846599132,2cyclictest22797-21apache_accesses10:15:110
18465991310,2cyclictest29389-21cut07:30:220
18465991310,2cyclictest20748-21chrt07:14:360
18465991310,2cyclictest12512-21ssh12:20:200
1846599130,12cyclictest49632sleep007:45:310
1846599130,12cyclictest15847-21tail11:20:190
1846999129,2cyclictest7437-21taskset07:51:453
1846999129,2cyclictest12180-21unixbench-2d08:00:273
1846999127,4cyclictest7744-21snmpd09:00:153
1846999127,4cyclictest39-21ksoftirqd/309:05:233
1846999123,3cyclictest224-21systemd-journal08:40:133
1846899127,3cyclictest23810-21taskset08:25:272
1846899125,3cyclictest224-21systemd-journal08:48:002
1846899125,3cyclictest224-21systemd-journal07:10:132
1846899122,4cyclictest224-21systemd-journal07:17:382
1846899121,4cyclictest224-21systemd-journal08:19:272
18468991210,1cyclictest23505-21taskset07:20:142
1846899120,7cyclictest224-21systemd-journal07:40:232
1846899120,4cyclictest224-21systemd-journal07:45:162
1846699129,2cyclictest322552sleep107:35:261
1846699129,2cyclictest28409-21cut07:30:161
1846699121,8cyclictest22492-21apt-get08:25:131
1846699120,6cyclictest141rcu_preempt07:45:291
1846599129,2cyclictest943-21basename07:40:150
1846599129,2cyclictest4520-21cut08:55:160
1846599129,2cyclictest326982sleep007:36:370
1846599129,2cyclictest30462-21head08:40:170
1846599129,2cyclictest13149-21ls08:05:150
1846599129,2cyclictest12743-21cat09:10:250
1846599129,2cyclictest12743-21cat09:10:250
1846599128,2cyclictest27480-21cat07:25:270
1846599120,11cyclictest2784-21expr08:50:180
1846899117,3cyclictest558-21lldpd07:50:172
1846899113,4cyclictest224-21systemd-journal08:20:182
1846599118,2cyclictest27325-21cut08:35:130
1846599118,2cyclictest16108-21grep08:10:190
18125292,2sleep20-21swapper/207:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional