You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 01:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Sun May 04, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1778302996638,25cyclictest1858399-21sh11:00:003
1778302995242,6cyclictest1786848-21grep07:30:273
1778302994840,5cyclictest1870516-21cut11:35:003
1778297994637,5cyclictest1872206-21munin-plugin-st11:40:002
1778293994520,5cyclictest131rcu_preempt09:35:191
1778302994431,9cyclictest391ktimers/309:15:143
1778297994436,5cyclictest1875611-21munin-plugin-st11:50:002
1778302994334,6cyclictest1841384-21fschecks_count10:10:183
1778293994334,6cyclictest1873490-21grep11:40:261
1778288994336,4cyclictest1854602-21munin-plugin-st10:50:000
1778293994234,5cyclictest1782224-21idleruntime-cro07:20:001
1778297994134,4cyclictest1818730-21idleruntime-cro09:05:002
1778293994128,9cyclictest231ktimers/109:50:151
1778297994029,6cyclictest1807634-21grep08:30:262
1778288994032,4cyclictest1837387-21cron10:00:000
1778302993933,4cyclictest1892602-21sendmail12:40:003
1778302993931,5cyclictest1816812-21idleruntime-cro09:00:013
1778302993930,6cyclictest1801761-21fschecks_time08:15:213
1778288993930,5cyclictest0-21swapper/008:15:000
1778302993828,6cyclictest0-21swapper/311:55:003
1778297993826,7cyclictest1779898-21cron07:15:002
1778297993826,7cyclictest0-21swapper/207:30:272
1778293993826,8cyclictest0-21swapper/109:00:011
1778302993730,4cyclictest1872190-21cron11:40:003
1778288993730,4cyclictest1879010-21sendmail12:00:000
1778288993730,4cyclictest1855419-21latency10:50:200
1778288993730,4cyclictest1855419-21latency10:50:190
1778288993728,6cyclictest1811263-21grep08:40:260
1778293993628,5cyclictest1892594-21sendmail12:40:001
1778293993628,5cyclictest1843074-21fschecks_count10:15:171
1778293993626,6cyclictest0-21swapper/109:20:001
1778288993625,7cyclictest1857939-21grep10:55:250
1778302993528,4cyclictest1847813-21munin-plugin-st10:30:003
1778302993526,6cyclictest1793634-21unixbench_multi07:50:283
1778297993527,4cyclictest1830620-21sendmail09:40:012
1778297993527,4cyclictest0-21swapper/210:20:262
1778293993527,4cyclictest0-21swapper/108:25:171
1778302993426,4cyclictest0-21swapper/307:15:183
1778302993423,7cyclictest1863257-21grep11:10:283
1778302993423,6cyclictest0-21swapper/309:20:283
1778297993425,6cyclictest311ktimers/208:15:172
1778297993425,4cyclictest0-21swapper/207:55:012
1778297993424,6cyclictest0-21swapper/210:40:002
1778297993422,7cyclictest1892582-21idleruntime-cro12:40:002
177829399344,6cyclictest24-21ksoftirqd/111:15:261
1778293993426,4cyclictest0-21swapper/112:20:281
1778293993425,6cyclictest1802607-21grep08:15:331
1778293993423,8cyclictest1885800-21sendmail12:20:001
177828899341,30cyclictest0-21swapper/010:35:140
1778302993326,4cyclictest1844406-21munin-plugin-st10:20:013
1778297993326,4cyclictest1849487-21cron10:35:002
1778297993326,4cyclictest1809825-21sendmail-msp08:40:002
1778297993322,7cyclictest1852495-21grep10:40:422
1778293993325,4cyclictest0-21swapper/111:55:261
1778293993313,3cyclictest131rcu_preempt07:43:291
1778302993224,4cyclictest0-21swapper/312:00:293
1778302993222,6cyclictest0-21swapper/310:05:263
1778302993221,7cyclictest0-21swapper/308:00:283
1778297993225,4cyclictest0-21swapper/209:55:302
1778297993224,4cyclictest0-21swapper/212:20:002
177829399325,8cyclictest24-21ksoftirqd/108:35:251
177829399325,7cyclictest24-21ksoftirqd/109:25:001
1778293993222,6cyclictest1870027-21grep11:30:251
1778293993222,6cyclictest0-21swapper/110:55:261
1778293993215,3cyclictest0-21swapper/107:55:251
1778293993213,3cyclictest131rcu_preempt12:01:281
1778293993212,3cyclictest131rcu_preempt09:48:061
1778288993224,4cyclictest0-21swapper/010:40:420
1778288993222,7cyclictest1888757-21grep12:25:260
1778288993219,10cyclictest121ktimers/008:30:130
1778302993121,6cyclictest0-21swapper/307:25:283
1778302993121,6cyclictest0-21swapper/307:25:283
1778302993120,8cyclictest0-21swapper/308:00:003
1778297993122,4cyclictest0-21swapper/209:15:172
1778297993119,8cyclictest1861369-21grep11:05:282
177829399316,10cyclictest1861026-21rt-features11:05:251
177829399315,7cyclictest24-21ksoftirqd/111:35:161
1778293993117,8cyclictest131rcu_preempt07:46:591
1778293993116,9cyclictest131rcu_preempt08:04:421
1778293993115,3cyclictest131rcu_preempt11:55:011
1778293993114,3cyclictest131rcu_preempt10:25:141
1778293993112,12cyclictest221rcuc/108:25:001
1778293993111,5cyclictest131rcu_preempt10:00:011
1778293993110,5cyclictest24-21ksoftirqd/108:45:261
1778288993124,4cyclictest0-21swapper/010:10:280
1778288993122,5cyclictest0-21swapper/011:20:010
1778288993121,6cyclictest1789024-21sendmail07:40:000
1778302993023,4cyclictest0-21swapper/310:30:253
1778302993022,5cyclictest0-21swapper/311:25:163
1778302993022,4cyclictest0-21swapper/311:55:263
1778302993022,4cyclictest0-21swapper/308:35:163
1778302993021,7cyclictest1854642-21apt-key10:50:013
1778302993021,5cyclictest0-21swapper/310:35:183
1778302993018,7cyclictest0-21swapper/311:20:263
1778297993017,7cyclictest0-21swapper/211:05:012
177829399307,3cyclictest0-21swapper/108:12:251
177829399305,12cyclictest24-21ksoftirqd/111:21:551
177829399303,7cyclictest24-21ksoftirqd/108:40:021
1778293993018,4cyclictest131rcu_preempt07:52:291
1778293993015,9cyclictest131rcu_preempt10:10:361
1778293993013,10cyclictest1848034-21/usr/sbin/munin10:30:171
1778288993022,5cyclictest0-21swapper/010:00:290
1778302992922,4cyclictest0-21swapper/311:40:263
1778302992922,4cyclictest0-21swapper/310:40:423
1778302992921,4cyclictest0-21swapper/311:15:263
1778302992919,7cyclictest391ktimers/312:10:143
1778302992919,6cyclictest0-21swapper/312:25:253
1778302992919,6cyclictest0-21swapper/311:45:273
1778302992918,7cyclictest0-21swapper/312:15:253
177829399299,5cyclictest131rcu_preempt10:05:121
177829399297,8cyclictest24-21ksoftirqd/110:45:211
177829399297,8cyclictest24-21ksoftirqd/108:05:221
177829399297,5cyclictest231ktimers/107:22:191
177829399295,7cyclictest24-21ksoftirqd/112:25:211
177829399295,7cyclictest24-21ksoftirqd/109:28:191
177829399293,7cyclictest24-21ksoftirqd/111:50:011
177829399292,6cyclictest24-21ksoftirqd/109:15:001
177829399292,6cyclictest24-21ksoftirqd/109:15:001
1778293992920,6cyclictest231ktimers/110:35:231
1778293992915,11cyclictest1778280-21cyclictest12:10:141
1778293992914,9cyclictest131rcu_preempt09:08:251
1778293992913,10cyclictest1832248-21kworker/u8:3-events_freezable_power_09:44:411
1778293992912,4cyclictest131rcu_preempt11:25:171
1778293992911,3cyclictest131rcu_preempt08:53:201
1778288992922,3cyclictest0-21swapper/008:15:210
1778288992921,5cyclictest1882839-21fschecks_time12:10:180
1778288992921,4cyclictest0-21swapper/011:00:270
1778288992919,6cyclictest0-21swapper/007:25:270
1778288992919,6cyclictest0-21swapper/007:25:270
177828899291,10cyclictest1887144-21taskset12:20:490
1778302992821,4cyclictest0-21swapper/309:50:013
1778302992821,3cyclictest0-21swapper/307:45:213
1778302992819,6cyclictest0-21swapper/308:05:263
1778302992818,6cyclictest0-21swapper/312:30:273
1778297992821,4cyclictest1842719-21idleruntime-cro10:15:012
1778297992821,3cyclictest0-21swapper/207:40:002
1778297992820,4cyclictest0-21swapper/210:10:002
1778297992820,4cyclictest0-21swapper/207:15:032
1778297992819,5cyclictest1868355-21tail11:25:252
1778297992819,5cyclictest0-21swapper/211:15:262
1778297992818,6cyclictest0-21swapper/210:20:012
1778297992815,9cyclictest1870497-21sh11:35:002
177829399288,18cyclictest231ktimers/111:10:161
177829399283,6cyclictest24-21ksoftirqd/112:10:001
177829399283,6cyclictest24-21ksoftirqd/112:10:001
1778293992823,3cyclictest1778280-21cyclictest10:44:081
1778293992822,3cyclictest0-21swapper/111:00:271
1778293992820,4cyclictest1856086-21unixbench_singl10:50:261
1778293992820,4cyclictest1856086-21unixbench_singl10:50:261
1778293992818,7cyclictest231ktimers/107:30:111
1778293992812,4cyclictest131rcu_preempt10:20:191
1778293992810,4cyclictest0-21swapper/110:04:541
177828899288,17cyclictest1846162-21date10:25:020
1778288992821,3cyclictest0-21swapper/012:05:010
1778288992820,4cyclictest0-21swapper/011:35:000
1778288992817,7cyclictest1868361-21grep11:25:250
177828899280,25cyclictest0-21swapper/009:45:150
1778302992721,4cyclictest1801170-21kworker/u8:1+events_unbound08:13:443
1778302992720,4cyclictest0-21swapper/307:45:013
1778302992717,6cyclictest0-21swapper/309:35:273
1778297992721,4cyclictest1814754-21kworker/u8:1+events_unbound09:13:542
1778297992721,4cyclictest1814754-21kworker/u8:1+events_unbound09:13:532
1778297992719,4cyclictest0-21swapper/212:00:292
1778297992718,7cyclictest1839117-21cut10:05:012
1778297992718,6cyclictest1854624-21grep10:50:002
1778297992718,5cyclictest1878993-21auditctl12:00:002
1778297992716,8cyclictest311ktimers/208:20:142
1778297992716,6cyclictest0-21swapper/211:40:262
177829399279,4cyclictest0-21swapper/112:33:421
177829399277,7cyclictest24-21ksoftirqd/107:25:221
177829399277,7cyclictest24-21ksoftirqd/107:25:221
1778293992721,4cyclictest382-21ntpd07:35:251
1778288992720,4cyclictest121ktimers/011:20:180
1778288992719,4cyclictest0-21swapper/009:50:190
1778288992719,4cyclictest0-21swapper/008:30:000
1778288992719,4cyclictest0-21swapper/008:05:170
1778288992718,6cyclictest1780022-21grep07:15:010
1778288992718,6cyclictest0-21swapper/011:10:170
1778288992718,5cyclictest1786892-21grep07:30:270
1778302992619,4cyclictest0-21swapper/309:55:303
1778302992614,9cyclictest1838213-21ntp_states10:00:243
1778302992614,8cyclictest391ktimers/311:00:153
1778297992619,5cyclictest1835641-21kworker/u8:0+events_unbound09:54:442
1778297992619,4cyclictest1799625-21idleruntime-cro08:10:012
1778297992615,8cyclictest1816883-21gpgv09:00:012
1778297992615,7cyclictest1797921-21auditctl08:05:012
177829799261,12cyclictest1831390-21taskset09:40:252
177829399266,5cyclictest24-21ksoftirqd/109:00:211
177829399266,4cyclictest0-21swapper/109:32:481
1778293992612,8cyclictest1753289-21kworker/u8:0-events_unbound07:10:251
1778288992620,4cyclictest1781959-21kworker/u8:3+events_unbound07:40:050
1778288992618,5cyclictest1892587-21idleruntime-cro12:40:000
1778288992618,5cyclictest0-21swapper/011:05:280
1778288992618,5cyclictest0-21swapper/008:05:010
1778302992516,5cyclictest0-21swapper/310:20:263
177830299251,4cyclictest18813132cat12:05:193
177830299251,4cyclictest18813132cat12:05:193
177829799252,4cyclictest0-21swapper/211:20:122
1778297992518,3cyclictest0-21swapper/210:55:012
1778297992518,3cyclictest0-21swapper/210:55:012
1778297992517,5cyclictest0-21swapper/212:20:272
1778297992516,5cyclictest0-21swapper/210:55:162
1778297992515,6cyclictest0-21swapper/209:25:002
1778297992510,4cyclictest131rcu_preempt07:25:382
1778297992510,4cyclictest131rcu_preempt07:25:372
1778288992518,4cyclictest0-21swapper/012:15:250
177828899251,6cyclictest1882044-21taskset12:05:490
177828899251,6cyclictest1882044-21taskset12:05:490
1778288992516,5cyclictest0-21swapper/008:49:090
177828899251,20cyclictest0-21swapper/008:37:490
1778302992418,3cyclictest0-21swapper/309:10:263
1778302992418,3cyclictest0-21swapper/309:10:263
1778302992416,5cyclictest391ktimers/308:20:173
1778302992415,6cyclictest0-21swapper/308:50:263
1778297992416,4cyclictest0-21swapper/209:05:262
1778297992416,4cyclictest0-21swapper/207:55:242
1778297992415,4cyclictest0-21swapper/211:10:282
1778297992413,8cyclictest1789802-21ntpq07:40:232
1778288992419,3cyclictest0-21swapper/007:55:270
1778288992416,5cyclictest0-21swapper/009:05:010
1778288992416,4cyclictest0-21swapper/011:35:160
1778288992415,6cyclictest0-21swapper/009:40:230
1778288992415,5cyclictest0-21swapper/010:15:270
1778288992415,5cyclictest0-21swapper/007:51:040
177828899241,20cyclictest0-21swapper/008:53:130
177828899241,19cyclictest0-21swapper/010:09:180
177828899241,19cyclictest0-21swapper/009:35:030
177828899241,19cyclictest0-21swapper/009:28:410
177828899241,19cyclictest0-21swapper/009:13:500
177828899241,19cyclictest0-21swapper/009:13:500
1778302992317,3cyclictest0-21swapper/309:55:013
1778302992317,3cyclictest0-21swapper/308:25:263
1778302992317,3cyclictest0-21swapper/307:20:273
1778302992316,3cyclictest0-21swapper/310:55:003
1778302992316,3cyclictest0-21swapper/310:55:003
1778302992315,5cyclictest0-21swapper/312:20:273
1778302992315,5cyclictest0-21swapper/309:25:253
1778297992316,3cyclictest0-21swapper/212:25:162
1778297992315,4cyclictest0-21swapper/211:50:252
1778297992312,7cyclictest1890469-21grep12:30:272
1778288992318,2cyclictest0-21swapper/010:30:180
1778288992317,4cyclictest121ktimers/011:40:120
1778288992316,3cyclictest0-21swapper/007:45:220
1778288992315,5cyclictest0-21swapper/010:25:200
1778288992311,9cyclictest1875938-21df11:50:140
177828899231,18cyclictest0-21swapper/012:31:470
1778288992310,10cyclictest0-21swapper/009:10:000
177828899230,19cyclictest0-21swapper/008:21:020
1778302992217,3cyclictest0-21swapper/308:45:223
1778302992215,4cyclictest1827448-21/usr/sbin/munin09:30:253
1778302992214,5cyclictest0-21swapper/308:30:243
177829799223,3cyclictest131rcu_preempt10:25:252
1778297992215,5cyclictest1806348-21kworker/u8:0+events_unbound08:42:192
1778297992215,4cyclictest1811696-21kworker/u8:2+events_unbound08:45:262
1778297992213,5cyclictest1801307-21auditctl08:15:002
177829799221,13cyclictest131rcu_preempt09:45:132
1778297992210,7cyclictest0-21swapper/212:10:272
1778297992210,2cyclictest131rcu_preempt12:06:052
1778297992210,2cyclictest131rcu_preempt12:06:052
1778288992216,3cyclictest0-21swapper/009:15:170
1778288992215,4cyclictest0-21swapper/007:20:290
1778288992213,7cyclictest1827958-21sed09:30:220
177828899221,19cyclictest0-21swapper/007:17:180
177828899220,18cyclictest0-21swapper/011:46:090
1778302992114,4cyclictest0-21swapper/308:40:273
1778302992112,6cyclictest1779330-21ls07:10:273
1778297992114,5cyclictest1790424-21kworker/u8:1+events_unbound07:48:522
1778297992114,4cyclictest0-21swapper/209:30:002
1778302992012,5cyclictest0-21swapper/311:10:013
1778302992012,5cyclictest0-21swapper/309:40:263
1778297992014,4cyclictest1827594-21fschecks_count09:30:182
1778297992011,6cyclictest1806520-21cut08:30:012
1778302991913,3cyclictest0-21swapper/309:00:223
1778297991812,4cyclictest1781959-21kworker/u8:3+events_unbound07:22:552
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional