You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-08 - 12:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Thu Jan 08, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1742891995136,11cyclictest121ktimers/020:30:130
1742895994939,7cyclictest1837739-21grep23:40:251
1742902994639,5cyclictest1765503-21kworker/u8:1+events_unbound20:36:093
1742902994639,4cyclictest1782997-21munin-plugin-st21:05:013
1742902994637,7cyclictest1849445-21kworker/u8:2+events_unbound00:18:443
1742902994634,8cyclictest1791079-21grep21:25:243
1742895994635,8cyclictest1836445-21idleruntime-cro23:40:011
1742897994335,5cyclictest1802012-21cat22:00:012
1742902994235,4cyclictest1797277-21fschecks_count21:45:163
1742902994224,5cyclictest1819077-21kworker/u8:3+events_unbound22:49:493
1742902994134,5cyclictest1801641-21kworker/u8:3+events_unbound21:56:203
1742897994134,4cyclictest1753704-21sendmail19:40:002
1742897994032,4cyclictest0-21swapper/223:30:012
1742895994032,4cyclictest1800308-21idleruntime-cro21:55:011
1742895994031,6cyclictest1828910-21unixbench_multi23:15:241
1742902993918,11cyclictest131rcu_preempt20:25:023
1742895993932,4cyclictest0-21swapper/122:15:151
1742891993929,6cyclictest1844537-21grep00:00:260
1742902993830,4cyclictest0-21swapper/321:35:003
1742891993827,7cyclictest1794468-21grep21:35:240
1742891993819,15cyclictest0-21swapper/020:40:010
1742897993729,4cyclictest1751964-21cron19:35:002
1742897993728,5cyclictest0-21swapper/221:10:152
1742891993730,3cyclictest0-21swapper/019:20:000
1742891993730,3cyclictest0-21swapper/019:20:000
1742891993727,6cyclictest0-21swapper/023:40:010
1742902993628,4cyclictest0-21swapper/322:51:263
1742897993630,4cyclictest1836441-21munin-plugin-st23:40:012
1742897993626,6cyclictest0-21swapper/221:30:242
1742902993529,4cyclictest1841439-21kworker/u8:1+events_unbound23:57:583
1742902993529,4cyclictest1742583-21kworker/u8:1+events_unbound19:16:023
1742902993529,4cyclictest1742583-21kworker/u8:1+events_unbound19:16:023
1742902993525,8cyclictest1742882-21cyclictest00:00:133
1742902993524,7cyclictest0-21swapper/323:45:233
1742897993523,7cyclictest0-21swapper/219:25:252
1742895993526,5cyclictest0-21swapper/123:10:161
1742891993526,6cyclictest1810111-21grep22:20:260
1742891993525,7cyclictest1770058-21ntp_kernel_err20:25:200
1742902993425,7cyclictest1844989-21kworker/u8:1+events_unbound00:08:273
1742902993425,5cyclictest0-21swapper/322:45:003
1742902993422,7cyclictest0-21swapper/323:10:263
1742902993411,13cyclictest40-21ksoftirqd/323:40:253
1742897993425,6cyclictest1727716-21kworker/u8:0+events_unbound19:10:142
1742897993424,6cyclictest1846467-21unixbench_multi00:05:292
1742895993426,4cyclictest0-21swapper/122:10:241
1742895993424,7cyclictest0-21swapper/122:05:001
1742891993423,6cyclictest1830646-21grep23:20:210
1742902993324,4cyclictest0-21swapper/321:55:013
1742902993318,5cyclictest131rcu_preempt21:20:143
1742902993314,10cyclictest1803960-21/usr/sbin/munin22:05:173
1742902993314,10cyclictest1803960-21/usr/sbin/munin22:05:173
1742902993312,12cyclictest40-21ksoftirqd/323:35:013
1742897993326,5cyclictest1775798-21kworker/u8:0+events_unbound20:41:102
1742897993325,4cyclictest0-21swapper/223:05:252
1742897993324,5cyclictest1768843-21tail20:20:242
1742897993321,7cyclictest0-21swapper/222:10:242
1742895993325,4cyclictest0-21swapper/123:01:281
1742895993324,5cyclictest1853772-21idleruntime-cro00:30:011
1742895993323,6cyclictest0-21swapper/121:40:001
1742895993319,10cyclictest231ktimers/120:20:121
1742891993326,5cyclictest1748307-21kworker/u8:1+events_unbound19:36:040
1742891993323,6cyclictest0-21swapper/020:20:240
1742891993323,6cyclictest0-21swapper/019:30:000
1742891993321,9cyclictest121ktimers/023:05:120
174290299327,6cyclictest40-21ksoftirqd/320:40:243
1742902993226,4cyclictest1803390-21kworker/u8:1+events_unbound22:18:403
1742902993226,4cyclictest1753366-21kworker/u8:0+events_unbound19:41:043
1742902993224,6cyclictest1788534-21kworker/u8:0+events_unbound21:36:423
1742902993224,5cyclictest1813575-21unixbench_singl22:30:263
1742902993224,5cyclictest1813575-21unixbench_singl22:30:263
1742902993213,11cyclictest131rcu_preempt20:25:143
174289799328,4cyclictest131rcu_preempt20:05:132
1742897993226,4cyclictest1829064-21kworker/u8:1+events_unbound23:47:332
1742897993225,4cyclictest1829383-21sh23:20:012
1742897993225,3cyclictest0-21swapper/221:20:162
1742897993219,7cyclictest1829064-21kworker/u8:1+events_unbound23:20:272
1742897993216,11cyclictest311ktimers/221:25:122
1742895993225,4cyclictest1812283-21kthreadd22:30:001
1742895993225,4cyclictest1812283-21kthreadd22:30:001
1742895993223,5cyclictest0-21swapper/123:50:161
1742891993224,4cyclictest0-21swapper/023:00:010
1742891993224,4cyclictest0-21swapper/000:20:230
174290299318,14cyclictest40-21ksoftirqd/321:41:073
174290299317,7cyclictest40-21ksoftirqd/322:15:003
1742902993121,6cyclictest1787653-21grep21:15:243
1742902993120,8cyclictest1824649-21tune2fs23:05:163
1742902993120,3cyclictest131rcu_preempt00:29:363
1742902993110,13cyclictest40-21ksoftirqd/322:55:153
1742902993110,11cyclictest40-21ksoftirqd/300:30:253
1742897993124,5cyclictest1806854-21kworker/u8:0+events_unbound22:25:172
1742897993124,5cyclictest1806854-21kworker/u8:0+events_unbound22:25:162
1742897993124,3cyclictest0-21swapper/200:15:012
1742897993123,4cyclictest0-21swapper/222:05:272
1742897993123,4cyclictest0-21swapper/222:05:272
1742897993121,7cyclictest1845056-21apt-key00:05:012
1742897993121,6cyclictest0-21swapper/221:50:252
1742897993121,6cyclictest0-21swapper/221:40:242
1742897993121,6cyclictest0-21swapper/221:39:592
174289799311,9cyclictest17624842grep20:05:012
1742895993123,4cyclictest0-21swapper/119:16:011
1742895993123,4cyclictest0-21swapper/119:16:001
1742895993122,6cyclictest0-21swapper/100:30:251
1742895993122,5cyclictest0-21swapper/120:55:171
1742895993121,7cyclictest1785940-21grep21:10:241
1742895993121,6cyclictest0-21swapper/123:20:221
1742895993120,6cyclictest0-21swapper/119:35:261
1742891993124,3cyclictest0-21swapper/000:15:250
1742891993123,4cyclictest0-21swapper/021:35:010
1742891993123,4cyclictest0-21swapper/020:00:270
1742891993121,7cyclictest1857195-21sendmail00:40:010
1742891993121,7cyclictest1808855-21cron22:19:590
174290299309,12cyclictest40-21ksoftirqd/323:30:003
174290299308,7cyclictest40-21ksoftirqd/320:45:253
1742902993024,4cyclictest1796776-21kworker/u8:0+events_unbound22:00:403
1742902993020,6cyclictest1841581-21munin-run23:55:013
1742902993020,6cyclictest1780789-21grep20:55:253
1742902993018,4cyclictest131rcu_preempt19:45:563
1742902993016,5cyclictest131rcu_preempt20:00:223
1742902993014,5cyclictest1755115-21kworker/u8:2-events_unbound20:08:453
174290299301,20cyclictest0-21swapper/319:10:113
1742902993011,11cyclictest131rcu_preempt19:30:253
174290299300,8cyclictest0-21swapper/300:20:103
1742897993023,3cyclictest0-21swapper/221:15:242
1742897993022,4cyclictest0-21swapper/222:40:152
1742897993022,4cyclictest0-21swapper/222:00:272
1742897993021,6cyclictest1779549-21sh20:55:012
1742895993023,4cyclictest0-21swapper/121:10:011
1742895993022,5cyclictest0-21swapper/120:10:161
1742895993022,4cyclictest0-21swapper/119:41:031
1742891993022,4cyclictest0-21swapper/021:30:000
174290299297,6cyclictest40-21ksoftirqd/323:00:263
174290299297,6cyclictest40-21ksoftirqd/321:05:263
1742902992920,6cyclictest1767664-21ls20:20:013
1742902992918,6cyclictest0-21swapper/322:25:253
1742902992918,6cyclictest0-21swapper/322:25:253
1742902992916,5cyclictest131rcu_preempt20:15:003
1742902992915,5cyclictest131rcu_preempt19:30:013
1742902992911,11cyclictest0-21swapper/319:54:593
174289799297,4cyclictest131rcu_preempt20:25:122
1742897992923,4cyclictest1844989-21kworker/u8:1+events_unbound00:24:412
1742897992921,4cyclictest0-21swapper/223:40:252
1742897992921,4cyclictest0-21swapper/220:55:262
1742897992917,10cyclictest311ktimers/200:30:102
174289799290,4cyclictest131rcu_preempt19:50:132
1742895992921,5cyclictest0-21swapper/120:30:161
1742895992921,4cyclictest0-21swapper/120:45:161
1742895992920,6cyclictest1838524-21fschecks_count23:45:141
1742895992920,6cyclictest1758614-21grep19:50:261
1742895992919,7cyclictest1844540-21unixbench_multi00:00:261
1742895992919,6cyclictest1763686-21grep20:05:241
1742895992919,5cyclictest1775715-21grep20:40:241
1742891992923,3cyclictest0-21swapper/020:55:010
1742891992920,5cyclictest1818640-21grep22:45:250
1742891992918,8cyclictest1853073-21grep00:25:230
1742891992918,8cyclictest1832948-21sed23:30:010
174289199291,5cyclictest1759170-21wc19:55:020
174290299288,5cyclictest131rcu_preempt22:20:263
174290299287,11cyclictest40-21ksoftirqd/320:50:203
174290299285,20cyclictest391ktimers/300:35:123
1742902992814,3cyclictest131rcu_preempt23:23:083
1742902992811,4cyclictest131rcu_preempt23:15:163
1742902992810,3cyclictest131rcu_preempt19:35:543
1742897992822,4cyclictest1753366-21kworker/u8:0+events_unbound19:44:422
1742897992818,6cyclictest0-21swapper/223:15:012
1742897992817,6cyclictest0-21swapper/200:00:012
1742895992821,4cyclictest1810137-21unixbench_singl22:20:261
1742895992821,4cyclictest0-21swapper/122:45:241
1742895992819,6cyclictest1845686-21tune2fs00:05:221
1742891992821,3cyclictest0-21swapper/023:50:130
1742891992820,4cyclictest0-21swapper/021:00:000
1742891992813,6cyclictest1764267-21latency_hist20:10:020
1742902992721,3cyclictest0-21swapper/323:35:263
1742902992716,7cyclictest0-21swapper/320:30:263
1742902992715,4cyclictest131rcu_preempt21:15:013
1742897992720,5cyclictest1819077-21kworker/u8:3+events_unbound22:50:152
1742897992720,5cyclictest1803390-21kworker/u8:1+events_unbound22:18:302
1742897992719,5cyclictest0-21swapper/222:20:262
1742895992720,4cyclictest1756174-21ntpq19:45:191
1742895992716,8cyclictest1849065-21tune2fs00:15:161
1742895992711,6cyclictest1744668-21cut19:15:011
1742891992717,5cyclictest0-21swapper/023:45:240
1742891992714,7cyclictest1804970-21grep22:05:270
1742891992714,7cyclictest1804970-21grep22:05:270
174289199271,22cyclictest1815854-21latency_hist22:40:010
174289199271,22cyclictest1815854-21latency_hist22:40:010
1742902992616,6cyclictest0-21swapper/319:20:243
1742902992616,6cyclictest0-21swapper/319:20:243
174289799268,5cyclictest1765503-21kworker/u8:1+events_unbound20:15:072
1742897992617,5cyclictest0-21swapper/220:30:252
174289799261,3cyclictest1814217-21apt-get22:35:112
174289799261,3cyclictest1814217-21apt-get22:35:112
1742897992611,7cyclictest32-21ksoftirqd/219:20:212
1742897992611,7cyclictest32-21ksoftirqd/219:20:212
1742895992619,4cyclictest0-21swapper/122:55:231
1742895992618,4cyclictest0-21swapper/122:51:261
1742895992616,6cyclictest0-21swapper/120:15:241
1742891992619,3cyclictest0-21swapper/019:15:010
1742891992615,8cyclictest1827907-21apt-get23:15:110
1742897992518,4cyclictest1746846-21sendmail19:20:002
1742897992518,4cyclictest1746846-21sendmail19:20:002
1742897992517,4cyclictest0-21swapper/222:30:162
1742897992517,4cyclictest0-21swapper/222:30:162
1742897992517,4cyclictest0-21swapper/221:45:252
1742897992514,8cyclictest311ktimers/219:55:132
174289799251,12cyclictest0-21swapper/220:45:242
1742895992517,4cyclictest0-21swapper/123:55:231
1742895992517,4cyclictest0-21swapper/123:35:011
1742895992517,4cyclictest0-21swapper/123:25:251
1742895992514,7cyclictest1761443-21grep20:00:201
1742891992519,3cyclictest0-21swapper/021:55:250
1742891992518,3cyclictest0-21swapper/000:08:250
1742891992514,8cyclictest204-21dbus-daemon21:11:140
174289199251,20cyclictest0-21swapper/022:44:340
1742891992511,7cyclictest131rcu_preempt20:40:110
1742897992418,4cyclictest1849445-21kworker/u8:2+events_unbound00:35:112
1742897992418,3cyclictest0-21swapper/223:50:242
1742897992417,3cyclictest0-21swapper/222:55:232
1742897992417,3cyclictest0-21swapper/200:30:012
1742897992416,5cyclictest1825624-21kworker/u8:2+events_unbound23:30:172
1742897992416,4cyclictest0-21swapper/223:00:262
1742897992414,6cyclictest0-21swapper/200:15:252
1742895992418,3cyclictest0-21swapper/100:35:201
1742895992416,5cyclictest0-21swapper/120:25:251
1742895992416,4cyclictest0-21swapper/119:25:251
1742895992412,9cyclictest231ktimers/123:05:121
1742891992418,3cyclictest1806236-21ntpq22:10:200
1742891992418,3cyclictest1763777-21kworker/u8:0-ext4-rsv-conversion20:20:020
1742891992417,5cyclictest0-21swapper/022:04:400
1742891992417,4cyclictest0-21swapper/021:55:000
1742891992417,3cyclictest0-21swapper/021:06:050
1742891992417,3cyclictest0-21swapper/021:00:080
1742891992415,6cyclictest13550irq/42-30be0000.ethernet19:30:130
1742891992414,4cyclictest131rcu_preempt22:54:320
174289199241,3cyclictest1786630-21apt-get21:15:110
174289199241,19cyclictest0-21swapper/023:03:190
174289199241,19cyclictest0-21swapper/021:49:320
1742897992312,8cyclictest1757219-21apt-config19:50:022
1742895992317,3cyclictest0-21swapper/121:55:161
1742895992316,5cyclictest0-21swapper/119:20:241
1742895992316,5cyclictest0-21swapper/119:20:241
1742895992315,4cyclictest1813997-21munin-plugin-st22:35:001
1742895992315,4cyclictest1813997-21munin-plugin-st22:34:591
1742895992315,4cyclictest0-21swapper/122:35:151
1742895992315,4cyclictest0-21swapper/122:35:151
1742895992313,7cyclictest1816085-21uniq22:40:161
1742891992317,3cyclictest0-21swapper/019:20:240
1742891992317,3cyclictest0-21swapper/019:20:230
1742891992316,3cyclictest0-21swapper/021:43:210
174289199231,3cyclictest1759260-21apt-get19:55:140
1742891992313,7cyclictest204-21dbus-daemon19:41:020
174289199231,20cyclictest0-21swapper/000:30:190
174289199231,19cyclictest0-21swapper/022:33:460
174289199231,19cyclictest0-21swapper/022:33:450
174289199230,19cyclictest0-21swapper/023:31:370
174289199230,19cyclictest0-21swapper/021:24:180
174289199230,19cyclictest0-21swapper/000:11:230
174289799227,7cyclictest131rcu_preempt21:05:172
1742897992216,4cyclictest1770782-21kworker/u8:0+events_unbound20:35:212
1742897992215,5cyclictest1765503-21kworker/u8:1+events_unbound21:02:572
1742895992216,4cyclictest1788534-21kworker/u8:0+events_unbound21:21:061
1742895992215,5cyclictest0-21swapper/122:05:271
1742895992215,5cyclictest0-21swapper/122:05:271
1742895992214,5cyclictest0-21swapper/120:50:251
1742895992214,4cyclictest0-21swapper/121:41:191
1742895992212,8cyclictest1742882-21cyclictest19:55:131
1742891992215,4cyclictest0-21swapper/019:45:220
1742891992215,3cyclictest0-21swapper/023:15:010
1742891992212,7cyclictest1842636-21date23:55:230
174289199220,18cyclictest0-21swapper/020:47:550
174289199220,18cyclictest0-21swapper/020:14:570
1742897992115,4cyclictest1763777-21kworker/u8:0+events_unbound20:11:082
1742897992114,4cyclictest1817804-21fschecks_count22:45:152
174289599216,3cyclictest0-21swapper/100:13:031
1742895992113,6cyclictest0-21swapper/121:45:231
1742895992112,5cyclictest231ktimers/121:05:011
1742891992116,3cyclictest13550irq/42-30be0000.ethernet22:25:140
1742891992116,3cyclictest13550irq/42-30be0000.ethernet22:25:140
1742895992014,3cyclictest1850756-21fschecks_count00:20:151
1742895992014,3cyclictest0-21swapper/121:15:191
174289599199,6cyclictest1773078-21grep20:35:131
174289599188,7cyclictest1792968-21seq21:31:471
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional