You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-13 - 21:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sun Oct 13, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
725599250,2cyclictest6602-21cron09:20:002
725199250,24cyclictest19611-21perf12:00:001
725999240,23cyclictest29007-21awk07:55:003
725999240,0cyclictest0-21swapper/310:27:143
725199240,23cyclictest6172-21latency_hist08:15:001
7255992320,2cyclictest16290-21sendmail09:40:012
725599231,21cyclictest593-21dbus-daemon08:05:012
725599230,22cyclictest26245-21apt-get08:55:012
725599230,22cyclictest16896-21awk07:30:002
725599230,22cyclictest0-21swapper/211:55:002
725599230,22cyclictest0-21swapper/211:47:152
725599230,1cyclictest13423-21cron08:30:002
7251992323,0cyclictest0-21swapper/110:12:141
7251992323,0cyclictest0-21swapper/107:12:131
725199230,22cyclictest3842-21perf09:15:001
725199230,1cyclictest21086-21apt-get09:50:011
725199230,0cyclictest5573-21apt-get11:32:131
7249992320,2cyclictest4372-21cron12:35:000
7249992320,2cyclictest19624-21cat12:00:000
724999230,22cyclictest31445-21ls09:05:000
7259992220,1cyclictest6661-21awk09:20:003
7259992220,1cyclictest31376-21dump-pmu-power08:00:003
7259992220,1cyclictest30050-21apt-get12:22:143
7259992219,2cyclictest18363-21munin-plugin-st10:50:003
725999220,22cyclictest0-21swapper/312:07:153
725999220,21cyclictest0-21swapper/309:12:163
725999220,21cyclictest0-21swapper/308:40:023
7255992222,0cyclictest0-21swapper/209:32:152
7255992221,1cyclictest0-21swapper/207:42:122
7255992220,1cyclictest32750-21idleruntime-cro11:20:012
7255992220,1cyclictest32022-21perf12:25:002
7255992220,1cyclictest0-21swapper/212:02:152
7255992219,2cyclictest13514-21cron10:40:002
725599220,21cyclictest31387-21awk08:00:012
725599220,21cyclictest0-21swapper/211:10:002
725599220,21cyclictest0-21swapper/208:30:022
725599220,1cyclictest32445-21apt-get12:27:152
7251992220,1cyclictest6795-21idleruntime-cro12:40:001
7251992220,1cyclictest17315-21apt-get07:32:131
725199220,21cyclictest19816-21apt-get07:37:131
725199220,21cyclictest0-21swapper/112:20:011
725199220,21cyclictest0-21swapper/109:25:001
725199220,21cyclictest0-21swapper/108:02:131
725199220,1cyclictest8030-21apt-get11:37:121
725199220,1cyclictest23172-21awk11:00:001
7249992220,1cyclictest0-21swapper/009:30:000
7249992220,1cyclictest0-21swapper/009:30:000
724999220,21cyclictest24631-21apt-get07:47:130
724999220,21cyclictest11482-21apt-get08:27:130
724999220,21cyclictest0-21swapper/011:22:140
724999220,21cyclictest0-21swapper/009:40:010
724999220,21cyclictest0-21swapper/008:02:130
7259992121,0cyclictest0-21swapper/312:02:153
7259992120,1cyclictest18778-21apt-get10:52:123
7259992120,0cyclictest0-21swapper/308:57:143
725999210,20cyclictest7715-21apt-get07:12:133
725999210,20cyclictest18710-21latency_hist09:45:013
725999210,20cyclictest1825-21apt-get08:07:143
725999210,20cyclictest0-21swapper/310:42:153
725999210,0cyclictest9180-21apt-get10:32:143
725999210,0cyclictest26740-21apt-get10:02:133
725999210,0cyclictest0-21swapper/308:17:153
7255992121,0cyclictest0-21swapper/212:40:002
7255992120,1cyclictest0-21swapper/207:47:132
7255992120,0cyclictest0-21swapper/209:57:152
7255992119,1cyclictest14491-21perf07:25:002
7255992118,2cyclictest8646-21idleruntime-cro08:20:002
725599210,21cyclictest0-21swapper/209:50:012
725599210,20cyclictest0-21swapper/211:32:132
725599210,20cyclictest0-21swapper/208:55:022
725599210,0cyclictest1869-21apt-get09:12:152
725599210,0cyclictest0-21swapper/211:27:152
7251992121,0cyclictest0-21swapper/110:32:141
7251992120,1cyclictest0-21swapper/112:30:001
7251992120,0cyclictest25989-21apt-get11:07:141
7251992120,0cyclictest0-21swapper/109:02:111
725199210,21cyclictest0-21swapper/109:42:131
725199210,20cyclictest0-21swapper/111:12:141
725199210,20cyclictest0-21swapper/108:32:121
725199210,20cyclictest0-21swapper/108:17:151
725199210,0cyclictest9089-21apt-get08:22:131
725199210,0cyclictest15238-21apt-get11:52:141
725199210,0cyclictest0-21swapper/109:47:141
725199210,0cyclictest0-21swapper/108:07:151
7249992121,0cyclictest29134-21apt-get10:07:130
7249992118,2cyclictest3821-21awk09:15:000
724999210,20cyclictest0-21swapper/012:27:150
724999210,20cyclictest0-21swapper/008:22:130
724999210,20cyclictest0-21swapper/008:07:150
724999210,20cyclictest0-21swapper/007:32:120
724999210,0cyclictest4829-21apt-get12:37:150
724999210,0cyclictest0-21swapper/011:37:120
724999210,0cyclictest0-21swapper/010:32:140
7259992020,0cyclictest30779-21apt-get11:17:133
7259992020,0cyclictest0-21swapper/312:37:153
7259992020,0cyclictest0-21swapper/311:02:143
7259992020,0cyclictest0-21swapper/309:22:133
7259992020,0cyclictest0-21swapper/308:47:133
7259992019,0cyclictest0-21swapper/311:42:163
7259992018,1cyclictest2745-21turbostat11:25:003
725999200,0cyclictest15238-21apt-get11:52:143
725999200,0cyclictest10112-21apt-get07:17:133
725999200,0cyclictest0-21swapper/311:07:133
725999200,0cyclictest0-21swapper/309:27:143
725999200,0cyclictest0-21swapper/309:27:143
725999200,0cyclictest0-21swapper/309:02:113
725999200,0cyclictest0-21swapper/307:37:133
7255992020,0cyclictest0-21swapper/211:57:142
7255992020,0cyclictest0-21swapper/210:22:152
7255992020,0cyclictest0-21swapper/209:22:132
7255992020,0cyclictest0-21swapper/208:37:132
7255992020,0cyclictest0-21swapper/207:32:122
7255992019,1cyclictest0-21swapper/210:12:142
7255992019,0cyclictest22447-21apt-get12:07:152
725599200,0cyclictest0-21swapper/211:02:142
725599200,0cyclictest0-21swapper/210:02:132
7251992020,0cyclictest23593-21apt-get11:02:141
7251992020,0cyclictest0-21swapper/108:37:141
7251992020,0cyclictest0-21swapper/107:42:131
7251992020,0cyclictest0-21swapper/107:17:131
7251992019,0cyclictest0-21swapper/110:02:131
7251992018,1cyclictest1397-21cron09:10:001
725199200,20cyclictest0-21swapper/112:17:161
725199200,20cyclictest0-21swapper/109:27:151
725199200,20cyclictest0-21swapper/109:27:151
725199200,20cyclictest0-21swapper/107:57:131
7249992020,0cyclictest29422-21apt-get07:57:130
7249992020,0cyclictest0-21swapper/012:17:160
7249992020,0cyclictest0-21swapper/012:12:150
7249992020,0cyclictest0-21swapper/010:47:140
7249992020,0cyclictest0-21swapper/010:12:140
7249992020,0cyclictest0-21swapper/010:02:130
7249992020,0cyclictest0-21swapper/009:57:150
7249992020,0cyclictest0-21swapper/009:07:130
7249992020,0cyclictest0-21swapper/008:47:130
7249992020,0cyclictest0-21swapper/007:42:130
7249992020,0cyclictest0-21swapper/007:12:130
7249992019,0cyclictest0-21swapper/008:37:140
7249992018,1cyclictest612-21gdbus09:50:000
7249992017,2cyclictest6195-21munin-plugin-st08:15:000
724999200,0cyclictest11577-21apt-get10:37:150
724999200,0cyclictest0-21swapper/010:27:140
724999200,0cyclictest0-21swapper/008:30:020
7259991919,0cyclictest0-21swapper/310:15:023
7259991918,0cyclictest0-21swapper/308:02:133
7255991919,0cyclictest0-21swapper/210:17:142
7255991919,0cyclictest0-21swapper/208:22:122
7255991919,0cyclictest0-21swapper/208:12:122
7255991919,0cyclictest0-21swapper/207:12:132
7255991918,0cyclictest16385-21apt-get10:47:142
7255991917,1cyclictest29233-21apt-get12:20:002
725199192,16cyclictest0-21swapper/111:17:131
7251991919,0cyclictest0-21swapper/112:07:151
7251991919,0cyclictest0-21swapper/111:45:001
7251991919,0cyclictest0-21swapper/110:42:151
7251991919,0cyclictest0-21swapper/110:17:141
7251991919,0cyclictest0-21swapper/109:37:121
725199190,0cyclictest0-21swapper/107:22:131
7249991919,0cyclictest27023-21apt-get07:52:120
7249991919,0cyclictest21175-21apt-get10:57:140
7249991919,0cyclictest19486-21apt-get08:42:140
7249991919,0cyclictest14921-21apt-get07:27:130
7249991919,0cyclictest0-21swapper/012:07:150
7249991919,0cyclictest0-21swapper/011:07:140
7249991919,0cyclictest0-21swapper/011:02:140
7249991919,0cyclictest0-21swapper/009:22:130
7249991919,0cyclictest0-21swapper/009:17:150
7249991919,0cyclictest0-21swapper/007:37:130
7249991919,0cyclictest0-21swapper/007:17:130
7249991918,1cyclictest28382-21apt-get11:12:140
7259991818,0cyclictest0-21swapper/311:27:153
7259991818,0cyclictest0-21swapper/307:32:133
7259991817,1cyclictest16673-21apt-get08:37:143
7259991817,1cyclictest0-21swapper/308:27:123
7259991817,0cyclictest31528-21apt-get10:12:143
7259991816,1cyclictest4217-21apt-get08:12:133
725599186,11cyclictest28-21ksoftirqd/211:42:162
7255991818,0cyclictest0-21swapper/210:42:152
7255991818,0cyclictest0-21swapper/210:32:142
7255991818,0cyclictest0-21swapper/209:47:142
7255991818,0cyclictest0-21swapper/209:41:442
7251991818,0cyclictest0-21swapper/109:57:151
7251991818,0cyclictest0-21swapper/108:47:131
7251991816,1cyclictest3834-21apt-get09:15:021
7249991818,0cyclictest24278-21apt-get08:52:140
7249991818,0cyclictest13992-21apt-get10:42:150
7249991818,0cyclictest0-21swapper/011:27:150
7249991818,0cyclictest0-21swapper/010:52:130
7249991818,0cyclictest0-21swapper/008:55:020
7249991818,0cyclictest0-21swapper/007:22:130
724999180,8cyclictest781-21lldpd11:47:160
7259991717,0cyclictest14324-21apt-get09:37:123
7259991717,0cyclictest0-21swapper/311:47:153
7259991717,0cyclictest0-21swapper/311:37:123
7259991717,0cyclictest0-21swapper/310:37:153
7259991717,0cyclictest0-21swapper/310:10:003
7259991717,0cyclictest0-21swapper/309:47:143
7259991717,0cyclictest0-21swapper/308:52:143
7259991716,1cyclictest0-21swapper/308:30:023
725999170,14cyclictest313-21systemd-journal07:25:003
7255991717,0cyclictest0-21swapper/210:07:132
7255991717,0cyclictest0-21swapper/209:07:132
7255991717,0cyclictest0-21swapper/209:02:112
7255991715,2cyclictest28-21ksoftirqd/209:27:152
7255991715,2cyclictest28-21ksoftirqd/209:27:152
7251991717,0cyclictest0-21swapper/110:37:141
7251991717,0cyclictest0-21swapper/110:22:141
7251991717,0cyclictest0-21swapper/108:52:141
7251991717,0cyclictest0-21swapper/108:27:121
7251991715,1cyclictest22028-21perf12:05:011
7251991715,1cyclictest14801-21dump-pmu-power11:50:001
7249991717,0cyclictest6616-21apt-get08:17:150
7249991717,0cyclictest11928-21apt-get09:32:150
7259991614,1cyclictest0-21swapper/309:55:003
725999160,15cyclictest0-21swapper/310:25:013
7255991616,0cyclictest0-21swapper/208:47:132
7255991616,0cyclictest0-21swapper/207:17:132
7251991616,0cyclictest26245-21apt-get08:55:021
7251991616,0cyclictest0-21swapper/110:47:141
7251991616,0cyclictest0-21swapper/107:52:131
7251991615,0cyclictest24842-21apt-get12:12:141
7251991615,0cyclictest0-21swapper/111:22:151
725199160,15cyclictest4083-21memory11:27:191
7249991616,0cyclictest0-21swapper/012:02:150
7249991616,0cyclictest0-21swapper/011:52:140
7249991615,1cyclictest6294-21wc10:25:010
7249991614,1cyclictest30844-21interrupts12:22:180
7259991515,0cyclictest2434-21apt-get12:32:163
7259991515,0cyclictest0-21swapper/312:12:153
7259991515,0cyclictest0-21swapper/307:47:133
725999150,2cyclictest1996-21cron12:30:003
725599153,12cyclictest28-21ksoftirqd/212:12:142
7255991515,0cyclictest6722-21apt-get10:27:132
7255991513,1cyclictest20762-21munin-run10:55:002
725599150,1cyclictest3003-21head08:07:212
725599150,14cyclictest27756-21modprobe07:52:162
7251991515,0cyclictest0-21swapper/110:52:131
7251991515,0cyclictest0-21swapper/107:27:131
7251991514,0cyclictest18636-21apt-get08:40:021
7259991414,0cyclictest0-21swapper/311:11:583
7259991414,0cyclictest0-21swapper/310:57:143
7259991414,0cyclictest0-21swapper/309:55:013
7259991414,0cyclictest0-21swapper/309:07:023
7259991414,0cyclictest0-21swapper/307:44:063
7259991414,0cyclictest0-21swapper/307:28:563
725999140,14cyclictest0-21swapper/309:30:083
725999140,0cyclictest0-21swapper/312:19:093
725999140,0cyclictest0-21swapper/308:21:423
7255991414,0cyclictest28382-21apt-get11:12:142
7255991414,0cyclictest0-21swapper/212:32:162
725599140,14cyclictest0-21swapper/210:57:112
725599140,0cyclictest0-21swapper/211:20:362
725599140,0cyclictest0-21swapper/208:41:212
7251991414,0cyclictest0-21swapper/109:30:101
725199140,0cyclictest0-21swapper/112:30:161
725199140,0cyclictest0-21swapper/107:46:161
7249991414,0cyclictest0-21swapper/010:15:040
724999140,14cyclictest0-21swapper/011:30:230
724999140,14cyclictest0-21swapper/011:15:260
724999140,14cyclictest0-21swapper/009:43:040
724999140,0cyclictest0-21swapper/011:40:180
7259991313,0cyclictest0-21swapper/311:55:273
725999130,0cyclictest0-21swapper/311:30:393
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional