You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 06:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue May 05, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1971842995446,5cyclictest2010110-21sh21:00:011
1971847995119,8cyclictest2049301-21grep22:50:272
1971838995139,9cyclictest121ktimers/023:05:140
1971847995024,21cyclictest0-21swapper/200:00:282
1971850994943,4cyclictest2047708-21kworker/u8:2+events_unbound23:13:013
1971847994818,26cyclictest311ktimers/221:10:122
1971847994740,4cyclictest2045937-21unixbench_singl22:40:232
1971842994734,9cyclictest2085793-21grep00:39:591
1971847994634,8cyclictest2055086-21apt-key23:10:002
1971847994617,5cyclictest2055472-21tune2fs23:10:152
1971842994638,5cyclictest2004998-21sh20:45:011
1971842994637,7cyclictest231ktimers/119:15:121
1971842994613,7cyclictest0-21swapper/122:50:271
1971847994521,3cyclictest0-21swapper/220:20:012
1971847994518,8cyclictest311ktimers/221:50:122
1971847994437,4cyclictest1989445-21sendmail20:00:012
1971842994418,4cyclictest0-21swapper/120:25:251
1971850994331,8cyclictest2058493-21cron23:20:003
1971850994233,7cyclictest2029786-21kworker/u8:0+events_unbound21:57:523
1971850994233,6cyclictest1982589-21cron19:39:593
1971850994233,4cyclictest2032301-21munin-plugin-st22:05:013
1971850994135,4cyclictest2011631-21kworker/u8:1+events_unbound21:12:373
1971847994128,9cyclictest1978762-21grep19:25:272
1971847994128,9cyclictest1978762-21grep19:25:262
1971850994021,4cyclictest0-21swapper/319:33:413
1971850994021,4cyclictest0-21swapper/319:33:413
1971850994019,4cyclictest0-21swapper/320:33:273
1971838994033,4cyclictest2023756-21munin-plugin-st21:40:000
1971838994033,4cyclictest2023756-21munin-plugin-st21:40:000
1971850993921,10cyclictest131rcu_preempt23:25:263
1971847993931,4cyclictest0-21swapper/222:10:012
1971847993928,6cyclictest0-21swapper/200:40:002
1971842993918,5cyclictest0-21swapper/122:20:211
1971850993828,6cyclictest2026763-21unixbench_singl21:45:253
1971850993828,4cyclictest2037329-21kworker/u8:2+events_unbound22:36:413
1971847993831,4cyclictest1982606-21munin-plugin-st19:40:002
1971842993828,5cyclictest0-21swapper/123:12:591
1971842993827,8cyclictest1980888-21sh19:35:001
1971842993827,8cyclictest1980888-21sh19:34:591
1971842993816,9cyclictest2010916-21ntpq21:00:221
1971838993831,4cyclictest2056341-21unixbench_multi23:10:250
1971850993731,4cyclictest2066718-21kworker/u8:3+events_unbound23:43:093
1971850993727,6cyclictest0-21swapper/320:20:263
1971850993727,6cyclictest0-21swapper/320:20:263
1971850993716,10cyclictest131rcu_preempt21:01:313
1971838993729,5cyclictest208-21systemd-logind21:22:370
1971838993723,10cyclictest121ktimers/020:00:140
1971838993714,4cyclictest0-21swapper/020:40:250
1971850993628,4cyclictest0-21swapper/321:30:003
1971850993622,4cyclictest131rcu_preempt21:06:593
1971850993618,5cyclictest131rcu_preempt21:35:213
1971850993618,5cyclictest131rcu_preempt21:35:213
1971850993615,10cyclictest131rcu_preempt23:22:593
1971847993628,4cyclictest0-21swapper/223:30:252
1971847993627,5cyclictest0-21swapper/222:30:002
1971847993627,5cyclictest0-21swapper/222:30:002
1971838993610,6cyclictest11-21ksoftirqd/023:45:010
1971850993527,4cyclictest0-21swapper/322:15:243
1971850993522,5cyclictest131rcu_preempt20:40:113
1971850993521,5cyclictest131rcu_preempt19:20:013
1971850993518,9cyclictest131rcu_preempt21:50:133
1971850993517,5cyclictest131rcu_preempt22:55:013
1971850993517,4cyclictest131rcu_preempt20:08:163
1971850993516,9cyclictest131rcu_preempt22:42:023
1971850993514,13cyclictest131rcu_preempt00:25:163
1971847993528,4cyclictest0-21swapper/222:55:172
1971847993528,3cyclictest0-21swapper/220:15:002
1971842993527,4cyclictest0-21swapper/121:50:001
1971842993527,4cyclictest0-21swapper/121:05:271
1971842993527,4cyclictest0-21swapper/120:05:161
1971842993526,5cyclictest1976189-21fschecks_count19:20:171
1971842993525,6cyclictest1973050-21unixbench_singl19:10:251
1971838993527,5cyclictest2082389-21munin-run00:30:000
197183899351,19cyclictest0-21swapper/019:55:150
1971850993428,4cyclictest2016907-21kworker/u8:2+events_unbound21:34:413
1971850993426,4cyclictest0-21swapper/323:50:233
1971850993425,5cyclictest2054434-21unixbench_multi23:05:273
1971850993423,4cyclictest131rcu_preempt19:50:543
1971850993422,5cyclictest131rcu_preempt22:14:003
1971850993422,5cyclictest131rcu_preempt00:05:003
1971850993417,4cyclictest131rcu_preempt21:44:493
1971850993417,11cyclictest131rcu_preempt21:17:473
1971850993416,5cyclictest131rcu_preempt23:30:263
1971850993415,5cyclictest131rcu_preempt20:55:263
1971847993424,7cyclictest2000309-21tune2fs20:30:162
1971842993426,5cyclictest2048060-21latency_hist22:50:001
1971842993424,7cyclictest0-21swapper/121:45:001
197183899346,11cyclictest2075040-21timerwakeupswit00:05:290
197183899343,12cyclictest2037768-21apt-config22:20:020
197185099339,15cyclictest40-21ksoftirqd/320:50:023
1971850993325,4cyclictest0-21swapper/300:15:163
1971850993323,4cyclictest131rcu_preempt20:16:303
1971850993320,5cyclictest131rcu_preempt19:45:063
1971850993320,4cyclictest131rcu_preempt00:24:073
1971850993319,10cyclictest438-21cron22:10:013
1971850993318,7cyclictest2083950-21kworker/u8:2+events_unbound00:35:023
1971850993316,6cyclictest131rcu_preempt19:25:243
1971850993316,6cyclictest131rcu_preempt19:25:243
1971850993316,5cyclictest2066718-21kworker/u8:3-events_freezable_power_23:46:383
1971850993313,10cyclictest131rcu_preempt23:59:163
1971850993312,3cyclictest0-21swapper/323:05:013
1971850993310,12cyclictest2076985-21kworker/u8:3-events_power_efficient00:14:573
1971847993325,5cyclictest0-21swapper/221:45:002
1971847993325,4cyclictest0-21swapper/222:20:172
1971847993325,4cyclictest0-21swapper/221:30:262
1971842993325,5cyclictest2027560-21grep21:50:161
1971842993325,4cyclictest0-21swapper/122:10:161
1971842993323,7cyclictest2063154-21grep23:30:261
1971842993323,6cyclictest0-21swapper/119:25:271
1971842993323,6cyclictest0-21swapper/119:25:271
1971842993322,7cyclictest2080200-21grep00:20:241
1971842993320,10cyclictest231ktimers/119:45:111
197183899338,11cyclictest1973758-21munin-node19:15:020
197183899336,9cyclictest1995284-21if_eth020:15:180
197183899336,9cyclictest1986251-21apt-get19:50:120
197183899336,10cyclictest2012223-21cut21:05:190
1971838993325,5cyclictest1998171-21cron20:25:000
1971838993325,5cyclictest1998171-21cron20:24:590
1971838993324,5cyclictest0-21swapper/021:40:240
1971838993310,2cyclictest2005230-21apt-get20:45:120
197185099324,4cyclictest0-21swapper/319:20:143
1971850993220,4cyclictest131rcu_preempt22:26:003
1971850993220,4cyclictest131rcu_preempt22:26:003
1971850993217,4cyclictest131rcu_preempt00:34:543
1971850993216,9cyclictest131rcu_preempt22:32:563
1971850993216,4cyclictest131rcu_preempt19:43:473
1971850993215,4cyclictest131rcu_preempt22:46:533
1971850993213,9cyclictest131rcu_preempt22:55:513
1971847993226,3cyclictest0-21swapper/220:55:012
1971847993224,4cyclictest0-21swapper/221:45:252
1971847993224,3cyclictest0-21swapper/222:00:272
1971847993223,6cyclictest2080679-21sh00:25:002
1971847993223,6cyclictest2004988-21cron20:45:012
1971847993223,6cyclictest0-21swapper/223:40:012
1971847993221,7cyclictest0-21swapper/219:20:172
1971842993224,4cyclictest0-21swapper/123:20:251
1971842993223,6cyclictest0-21swapper/121:55:241
1971842993223,5cyclictest0-21swapper/121:25:011
197183899329,19cyclictest2040559-21grep22:25:260
197183899329,19cyclictest2040559-21grep22:25:260
197183899324,21cyclictest0-21swapper/019:42:170
1971838993222,7cyclictest2032297-21idleruntime-cro22:05:010
1971838993213,15cyclictest0-21swapper/022:05:110
197185099318,14cyclictest40-21ksoftirqd/321:25:003
197185099318,13cyclictest40-21ksoftirqd/320:10:253
1971850993121,6cyclictest0-21swapper/320:25:243
1971850993120,4cyclictest131rcu_preempt23:38:433
1971850993119,4cyclictest131rcu_preempt22:21:263
1971850993115,4cyclictest1985782-21kworker/u8:3+events_unbound20:02:433
1971850993113,10cyclictest131rcu_preempt00:05:253
1971847993125,3cyclictest0-21swapper/222:20:002
1971847993124,4cyclictest0-21swapper/223:40:252
1971847993123,4cyclictest0-21swapper/223:25:272
1971847993121,6cyclictest2002821-21grep20:35:242
1971842993123,4cyclictest0-21swapper/100:15:001
1971842993121,7cyclictest2058499-21idleruntime-cro23:20:001
1971842993119,9cyclictest231ktimers/120:00:131
197183899318,7cyclictest0-21swapper/021:55:200
1971850993019,4cyclictest131rcu_preempt19:10:433
1971850993012,3cyclictest0-21swapper/319:55:213
1971847993023,4cyclictest0-21swapper/220:55:172
1971847993022,4cyclictest0-21swapper/220:20:262
1971847993022,4cyclictest0-21swapper/220:20:262
1971847993021,6cyclictest2076249-21cat00:10:202
1971847993021,6cyclictest0-21swapper/222:35:012
1971847993021,6cyclictest0-21swapper/200:20:002
1971847993021,5cyclictest0-21swapper/222:35:242
1971847993020,6cyclictest1973054-21unixbench_singl19:10:262
1971842993023,4cyclictest0-21swapper/120:15:261
1971842993021,6cyclictest0-21swapper/100:15:261
1971842993020,6cyclictest0-21swapper/120:52:311
197183899309,5cyclictest2058844-21df23:20:130
197183899308,3cyclictest2070666-21apt-get23:55:110
1971838993023,3cyclictest0-21swapper/019:45:250
1971838993022,4cyclictest0-21swapper/023:40:010
197183899302,24cyclictest0-21swapper/019:35:010
197183899302,24cyclictest0-21swapper/019:35:000
1971838993020,6cyclictest0-21swapper/000:00:280
1971838993016,10cyclictest2011473-21cron21:01:010
1971838993010,5cyclictest11-21ksoftirqd/023:00:000
197185099299,12cyclictest40-21ksoftirqd/320:35:193
1971850992917,4cyclictest131rcu_preempt20:50:223
1971847992922,4cyclictest0-21swapper/220:25:252
1971847992921,5cyclictest0-21swapper/223:25:012
1971847992920,5cyclictest0-21swapper/222:15:012
1971842992921,4cyclictest0-21swapper/123:25:271
1971842992921,4cyclictest0-21swapper/120:00:011
197183899297,19cyclictest2006936-21/usr/sbin/munin20:50:140
197183899292,4cyclictest1982591-21cron19:40:000
1971838992913,3cyclictest2026037-21irqstats21:45:170
1971838992912,3cyclictest2008631-21apt-get20:55:120
1971847992822,3cyclictest0-21swapper/223:50:002
1971847992821,5cyclictest0-21swapper/221:20:012
1971847992820,4cyclictest2048064-21idleruntime-cro22:50:012
1971847992819,6cyclictest0-21swapper/219:35:002
1971847992819,6cyclictest0-21swapper/219:35:002
1971842992819,6cyclictest1987200-21sort19:50:251
1971842992818,6cyclictest0-21swapper/122:35:151
197183899282,8cyclictest0-21swapper/019:21:180
1971847992721,3cyclictest0-21swapper/219:45:152
1971847992720,4cyclictest0-21swapper/219:15:172
1971847992719,5cyclictest0-21swapper/221:40:012
1971847992719,5cyclictest0-21swapper/221:40:012
1971847992717,7cyclictest2012426-21sshd21:05:212
1971847992717,7cyclictest1992835-21cron20:10:012
1971842992719,4cyclictest0-21swapper/122:25:271
1971842992719,4cyclictest0-21swapper/122:25:261
1971842992719,4cyclictest0-21swapper/121:10:251
1971842992716,7cyclictest0-21swapper/120:35:251
1971838992721,3cyclictest2020580-21apt-get21:30:130
1971838992720,4cyclictest2084077-21cron00:35:000
1971838992717,6cyclictest0-21swapper/021:50:260
1971838992716,8cyclictest2015753-21if_eth021:15:160
1971838992716,8cyclictest1979136-21sshd19:29:230
1971838992716,8cyclictest1979136-21sshd19:29:230
1971838992711,9cyclictest131rcu_preempt22:10:320
197183899271,17cyclictest11-21ksoftirqd/000:35:130
197183899271,11cyclictest2001436-21taskset20:33:220
1971847992615,9cyclictest311ktimers/219:50:142
197184299265,17cyclictest2033566-21unixbench_singl22:05:261
1971842992620,3cyclictest0-21swapper/123:45:241
1971842992618,5cyclictest0-21swapper/122:55:261
1971842992618,4cyclictest0-21swapper/122:30:161
1971842992618,4cyclictest0-21swapper/100:30:001
1971842992617,5cyclictest2075558-21auditctl00:09:591
1971842992615,7cyclictest1-21systemd23:38:061
1971842992614,8cyclictest2072142-21munin-run00:00:001
197183899269,11cyclictest131rcu_preempt22:31:300
197183899268,13cyclictest2049882-21latency_hist22:55:010
197183899268,13cyclictest2048246-21latency_hist22:50:010
197183899263,20cyclictest2057017-21/usr/sbin/munin23:15:110
197183899263,20cyclictest2037514-21apt-config22:20:010
1971838992619,3cyclictest0-21swapper/023:00:260
1971838992619,3cyclictest0-21swapper/000:15:000
1971838992616,6cyclictest2019896-21unixbench_multi21:25:260
1971838992614,9cyclictest2043269-21/usr/sbin/munin22:35:120
1971838992614,9cyclictest1991658-21/usr/sbin/munin20:05:170
1971838992613,10cyclictest2078476-21/usr/sbin/munin00:15:250
1971847992518,3cyclictest0-21swapper/223:00:262
1971847992517,5cyclictest0-21swapper/220:50:012
1971842992519,3cyclictest0-21swapper/123:44:591
1971842992519,3cyclictest0-21swapper/121:30:201
1971842992518,4cyclictest1996917-21fschecks_time20:20:161
1971842992518,4cyclictest1996917-21fschecks_time20:20:151
1971842992518,4cyclictest0-21swapper/120:45:151
1971842992517,4cyclictest0-21swapper/121:15:161
1971842992516,6cyclictest2019337-21cat21:25:201
1971842992515,7cyclictest0-21swapper/121:35:211
1971842992515,7cyclictest0-21swapper/121:35:201
1971842992514,7cyclictest2045930-21grep22:40:231
1971838992512,8cyclictest1973663-21latency_hist19:15:010
197183899251,20cyclictest0-21swapper/000:21:260
1971847992418,3cyclictest0-21swapper/220:00:262
1971847992418,3cyclictest0-21swapper/200:25:162
197184799241,19cyclictest2011815-21sh21:05:002
1971842992418,3cyclictest2055004-21latency_hist23:10:011
1971842992418,3cyclictest0-21swapper/100:00:231
1971842992416,4cyclictest0-21swapper/120:10:161
1971842992413,8cyclictest231ktimers/119:40:131
197183899247,14cyclictest2061485-21grep23:25:270
197183899246,14cyclictest2002400-21awk20:35:210
1971838992418,4cyclictest2062142-21apt-get23:30:120
197183899241,4cyclictest1998516-21df20:25:140
1971838992414,7cyclictest2013883-21forks21:10:150
1971838992413,8cyclictest1993550-21/usr/sbin/munin20:10:200
197183899241,19cyclictest0-21swapper/022:40:540
1971847992317,4cyclictest1982843-21/usr/sbin/munin19:40:182
1971847992313,7cyclictest2018231-21grep21:20:262
1971847992312,8cyclictest2057196-21grep23:15:162
1971842992317,3cyclictest0-21swapper/120:30:201
197184299231,15cyclictest2070578-21wc23:55:011
1971838992313,7cyclictest2067601-21irqstats23:45:160
1971847992216,3cyclictest0-21swapper/223:50:242
1971847992214,5cyclictest0-21swapper/221:55:162
1971847992212,6cyclictest2019913-21grep21:25:262
1971842992216,4cyclictest145-21jbd2/mmcblk1p2-822:00:071
1971842992216,3cyclictest0-21swapper/100:30:191
1971847992115,3cyclictest0-21swapper/200:30:182
1971847992014,3cyclictest0-21swapper/200:05:282
1971847992010,7cyclictest2072146-21sendmail23:59:592
1971842992013,5cyclictest231ktimers/119:35:171
1971842992013,3cyclictest0-21swapper/122:17:521
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional