You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 07:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Tue Sep 01, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119339995142,5cyclictest182129-21ls22:10:011
119335994434,7cyclictest205997-21grep23:15:260
119335994434,7cyclictest205997-21grep23:15:260
119335994433,8cyclictest166564-21sh21:25:000
119346994329,11cyclictest391ktimers/319:55:143
119341994336,4cyclictest178238-21unixbench_multi21:55:272
119339994336,5cyclictest183588-21kworker/u8:1+events_unbound22:47:321
119339994132,5cyclictest199168-21auditctl23:00:001
119341994033,4cyclictest0-21swapper/223:00:002
119335994030,6cyclictest202547-21grep23:05:250
119341993929,6cyclictest0-21swapper/223:10:002
119335993915,4cyclictest211981-21apt-get23:35:110
119346993826,8cyclictest142025-21grep20:10:273
119346993813,7cyclictest191395-21ls22:35:213
119341993829,5cyclictest0-21swapper/200:40:002
119339993832,4cyclictest220281-21munin-plugin-st00:00:001
119346993731,4cyclictest206420-21cron23:20:003
119346993731,4cyclictest206420-21cron23:20:003
119346993728,6cyclictest0-21swapper/321:45:253
119341993730,3cyclictest0-21swapper/220:00:012
119341993728,6cyclictest0-21swapper/221:50:012
119339993725,7cyclictest0-21swapper/119:50:011
11934699367,16cyclictest40-21ksoftirqd/322:50:013
119341993630,3cyclictest0-21swapper/223:35:012
119341993629,3cyclictest0-21swapper/220:30:012
11933599368,10cyclictest154739-21cstates20:50:140
11933599368,10cyclictest154739-21cstates20:50:140
119346993528,4cyclictest231632-21apt-key00:35:013
119346993523,4cyclictest131rcu_preempt20:05:143
119341993528,4cyclictest195773-21ls22:50:002
119341993528,3cyclictest0-21swapper/219:20:012
11933599359,8cyclictest11-21ksoftirqd/020:05:160
119335993527,4cyclictest0-21swapper/000:37:580
119346993427,5cyclictest224212-21kworker/u8:0+events_unbound00:12:423
119346993425,6cyclictest0-21swapper/300:00:243
119346993423,4cyclictest2264232date00:20:013
119346993412,3cyclictest131rcu_preempt19:15:053
119341993427,3cyclictest0-21swapper/220:35:002
119339993426,5cyclictest130312-21cron19:40:011
119339993426,4cyclictest0-21swapper/100:20:261
119339993425,6cyclictest0-21swapper/121:25:001
119339993425,5cyclictest0-21swapper/123:30:001
119339993422,7cyclictest0-21swapper/100:37:481
119335993428,3cyclictest0-21swapper/019:35:270
119335993411,7cyclictest224884-21df_inode00:15:140
11934699336,7cyclictest40-21ksoftirqd/320:15:193
11934699335,7cyclictest40-21ksoftirqd/323:00:013
119346993323,7cyclictest204309-21grep23:10:263
119346993323,7cyclictest204309-21grep23:10:253
119346993321,9cyclictest391ktimers/321:10:023
119346993320,5cyclictest131rcu_preempt23:32:213
119346993319,9cyclictest131rcu_preempt00:07:133
119346993313,10cyclictest131rcu_preempt19:40:123
119346993312,3cyclictest0-21swapper/322:25:183
119346993310,10cyclictest162202-21ntp_kernel_pll_21:10:193
119341993327,3cyclictest0-21swapper/223:25:252
119341993324,6cyclictest0-21swapper/200:35:022
119339993323,7cyclictest190635-21cron22:35:001
11933599334,15cyclictest0-21swapper/023:25:200
11934699325,7cyclictest40-21ksoftirqd/319:10:253
119346993224,4cyclictest0-21swapper/321:20:253
119346993220,6cyclictest131rcu_preempt20:24:343
119346993217,9cyclictest131rcu_preempt21:15:213
119346993215,14cyclictest391ktimers/300:38:023
119346993215,10cyclictest131rcu_preempt00:22:183
119346993213,11cyclictest131rcu_preempt20:50:023
119346993213,11cyclictest131rcu_preempt20:50:013
119341993223,6cyclictest130744-21fschecks_time19:40:172
119339993224,4cyclictest0-21swapper/123:40:151
119339993221,7cyclictest0-21swapper/100:05:001
119335993225,4cyclictest231380-21idleruntime-cro00:35:000
119335993225,4cyclictest0-21swapper/023:45:250
119335993222,7cyclictest143714-21grep20:15:260
11934699317,7cyclictest40-21ksoftirqd/321:40:233
119346993125,4cyclictest381rcuc/322:50:143
119346993125,3cyclictest0-21swapper/323:50:243
119346993123,4cyclictest0-21swapper/323:45:253
119346993122,6cyclictest0-21swapper/319:25:173
119346993121,7cyclictest391ktimers/322:05:173
119346993121,7cyclictest391ktimers/321:51:113
119346993116,9cyclictest131rcu_preempt20:33:503
119341993125,4cyclictest211232-21kworker/u8:1+events_unbound23:37:362
119341993125,4cyclictest144170-21grep20:20:012
119341993124,4cyclictest0-21swapper/222:00:142
119341993122,6cyclictest170410-21fschecks_time21:35:152
119341993121,7cyclictest158447-21grep21:00:172
119339993124,4cyclictest171116-21runrttasks21:35:231
119339993123,4cyclictest0-21swapper/121:15:001
119339993121,7cyclictest0-21swapper/122:20:261
11933599318,9cyclictest196115-21/usr/sbin/munin22:50:140
119335993118,9cyclictest204-21dbus-daemon20:57:130
11934699307,7cyclictest40-21ksoftirqd/322:10:173
11934699302,7cyclictest40-21ksoftirqd/320:35:253
119346993024,3cyclictest0-21swapper/320:55:003
119346993024,3cyclictest0-21swapper/320:55:003
119346993020,5cyclictest131rcu_preempt23:35:153
119346993016,3cyclictest131rcu_preempt22:42:403
119346993015,9cyclictest131rcu_preempt19:50:123
119346993015,3cyclictest131rcu_preempt23:05:013
119346993015,10cyclictest131rcu_preempt22:17:553
119346993010,17cyclictest381rcuc/319:33:123
119341993023,4cyclictest0-21swapper/220:45:172
119341993023,4cyclictest0-21swapper/220:45:172
119341993023,3cyclictest0-21swapper/223:10:232
119341993023,3cyclictest0-21swapper/223:10:232
119341993022,4cyclictest0-21swapper/221:05:262
11934199301,26cyclictest53-21kcompactd000:05:272
119339993022,4cyclictest0-21swapper/122:20:001
119339993022,4cyclictest0-21swapper/120:35:261
119339993020,5cyclictest124730-21grep19:20:251
11933599307,6cyclictest11-21ksoftirqd/023:30:160
119335993022,4cyclictest0-21swapper/023:10:250
119335993022,4cyclictest0-21swapper/023:10:250
119335993022,4cyclictest0-21swapper/021:50:000
119335993011,8cyclictest131rcu_preempt21:29:310
11934699298,5cyclictest131rcu_preempt19:45:153
11934699296,8cyclictest40-21ksoftirqd/321:55:283
11934699294,6cyclictest40-21ksoftirqd/319:35:183
11934699294,15cyclictest40-21ksoftirqd/323:40:253
11934699293,8cyclictest40-21ksoftirqd/322:30:213
119346992922,4cyclictest0-21swapper/323:20:153
119346992919,6cyclictest0-21swapper/321:40:003
119346992918,8cyclictest209401-21grep23:25:253
119346992910,5cyclictest131rcu_preempt19:20:133
119341992922,5cyclictest218523-21kworker/u8:0+events_unbound00:02:412
119341992921,4cyclictest0-21swapper/221:20:162
119341992917,7cyclictest0-21swapper/222:40:002
119339992923,4cyclictest119116-21kworker/u8:1+events_unbound19:12:081
119339992922,5cyclictest134744-21kworker/u8:2+events_unbound19:57:091
119339992922,4cyclictest0-21swapper/119:15:261
119339992919,7cyclictest0-21swapper/120:40:261
11933599298,18cyclictest119495-21/usr/sbin/munin19:10:150
11933599296,19cyclictest123414-21latency_hist19:20:010
119335992922,4cyclictest178705-21latency_hist22:00:000
119335992916,4cyclictest131rcu_preempt21:41:570
119335992913,3cyclictest197807-21df22:55:140
119335992913,3cyclictest137701-21df_inode20:00:160
119335992911,7cyclictest131rcu_preempt22:47:190
11934699288,6cyclictest40-21ksoftirqd/320:00:313
11934699286,5cyclictest40-21ksoftirqd/321:00:143
11934699285,7cyclictest40-21ksoftirqd/320:25:193
11934699284,6cyclictest156108-21apt-get20:55:053
11934699283,6cyclictest40-21ksoftirqd/322:20:253
11934699281,9cyclictest40-21ksoftirqd/323:07:093
119346992818,7cyclictest381rcuc/300:29:193
119346992815,4cyclictest131rcu_preempt21:27:383
119341992820,4cyclictest0-21swapper/219:20:252
119341992818,6cyclictest0-21swapper/221:25:262
119339992822,4cyclictest167937-21kworker/u8:0+events_unbound21:32:151
119339992821,4cyclictest0-21swapper/121:55:271
119339992821,4cyclictest0-21swapper/121:00:261
119339992820,4cyclictest0-21swapper/120:15:171
119339992820,4cyclictest0-21swapper/119:42:071
119339992820,4cyclictest0-21swapper/100:10:221
11933599288,7cyclictest125544-21df19:25:150
11933599287,7cyclictest151797-21ntp_states20:40:220
11933599287,4cyclictest133725-21apt-get19:50:040
11933599286,4cyclictest11-21ksoftirqd/022:05:150
11933599285,8cyclictest206841-21fschecks_count23:20:140
11933599285,20cyclictest189021-21latency_hist22:30:010
11933599283,23cyclictest0-21swapper/019:55:230
11933599283,14cyclictest0-21swapper/023:02:230
119335992823,3cyclictest216810-21kworker/u8:2+events_unbound23:52:410
119335992819,6cyclictest141441-21memory20:10:210
119335992812,3cyclictest145495-21users20:20:270
119335992811,6cyclictest131rcu_preempt22:12:010
119346992715,9cyclictest391ktimers/320:40:203
119346992713,5cyclictest131rcu_preempt22:00:103
119346992710,5cyclictest131rcu_preempt23:55:153
119341992721,4cyclictest134744-21kworker/u8:2+events_unbound20:12:092
119341992721,3cyclictest0-21swapper/222:25:242
119341992721,3cyclictest0-21swapper/221:15:262
119341992720,4cyclictest0-21swapper/220:40:002
119341992720,3cyclictest0-21swapper/219:55:012
119339992721,3cyclictest0-21swapper/123:00:251
119339992720,4cyclictest191408-21ntpq22:35:221
119339992720,4cyclictest0-21swapper/123:25:001
119339992719,4cyclictest0-21swapper/121:15:261
119339992717,6cyclictest173807-21cut21:45:161
119339992717,6cyclictest0-21swapper/123:20:011
119339992717,6cyclictest0-21swapper/123:20:001
119339992716,8cyclictest157631-21users20:55:301
11933599279,9cyclictest131rcu_preempt00:29:270
11933599279,8cyclictest131rcu_preempt23:40:270
119335992723,2cyclictest13550irq/42-30be0000.ethernet00:01:230
119335992720,4cyclictest185532-21sendmail22:20:010
119335992719,6cyclictest153885-21sort20:45:250
119335992719,6cyclictest153885-21sort20:45:250
119335992718,6cyclictest0-21swapper/021:10:010
119335992716,8cyclictest178952-21apt-get22:00:110
119335992715,8cyclictest161900-21tune2fs21:10:150
119335992714,10cyclictest221989-21apt-get00:05:060
119335992714,10cyclictest150202-21/usr/sbin/munin20:35:240
119335992711,12cyclictest191759-21cat22:35:260
119341992620,4cyclictest186104-21interrupts22:20:182
119341992620,3cyclictest119326-21cyclictest19:45:122
119341992620,3cyclictest0-21swapper/222:50:142
119341992620,3cyclictest0-21swapper/221:40:272
119341992617,5cyclictest199813-21fschecks_time23:00:152
119339992618,4cyclictest0-21swapper/100:17:441
119339992617,6cyclictest150757-21kworker/u8:0+events_unbound20:47:141
119339992617,6cyclictest150757-21kworker/u8:0+events_unbound20:47:141
119339992617,5cyclictest202548-21grep23:05:251
119339992613,8cyclictest231ktimers/100:05:271
11933599264,7cyclictest175091-21apt-get21:50:020
119335992621,3cyclictest0-21swapper/021:15:130
119335992616,7cyclictest147926-21/usr/sbin/munin20:30:130
119341992519,3cyclictest0-21swapper/222:40:192
119341992519,3cyclictest0-21swapper/220:50:152
119341992519,3cyclictest0-21swapper/220:50:142
119341992518,4cyclictest0-21swapper/223:55:262
119341992517,5cyclictest0-21swapper/220:40:272
119341992517,5cyclictest0-21swapper/219:35:262
119339992518,4cyclictest0-21swapper/100:30:161
119339992517,5cyclictest0-21swapper/100:25:261
119339992516,6cyclictest0-21swapper/119:30:241
119339992516,5cyclictest0-21swapper/123:40:011
119339992515,7cyclictest231ktimers/122:25:121
119339992515,6cyclictest167787-21grep21:25:261
119339992514,8cyclictest179904-21cat22:00:231
119339992514,7cyclictest161038-21grep21:05:261
11933999250,3cyclictest131rcu_preempt23:35:011
11933599259,12cyclictest171246-21grep21:35:240
11933599257,8cyclictest131rcu_preempt21:32:180
11933599255,8cyclictest133608-21taskset19:48:400
11933599253,3cyclictest123275-21apt-get19:20:060
119335992516,6cyclictest218802-21apt-get23:55:130
119335992515,7cyclictest0-21swapper/022:20:230
119335992514,8cyclictest127477-21/usr/sbin/munin19:30:170
119335992514,7cyclictest190819-21sed22:35:010
119335992514,7cyclictest158269-21apt-get21:00:140
119335992511,5cyclictest131rcu_preempt22:41:220
119341992418,3cyclictest0-21swapper/222:15:122
119339992418,3cyclictest0-21swapper/121:50:141
119339992418,3cyclictest0-21swapper/120:30:151
119339992417,3cyclictest0-21swapper/123:45:251
119339992416,5cyclictest0-21swapper/122:50:161
11933999241,3cyclictest131rcu_preempt20:05:011
119339992413,8cyclictest193649-21grep22:40:251
11933999240,12cyclictest0-21swapper/119:53:061
11933599249,8cyclictest131rcu_preempt00:11:230
11933599247,13cyclictest227956-21cron00:25:000
119335992417,5cyclictest0-21swapper/020:26:040
119341992317,3cyclictest0-21swapper/222:10:192
119341992317,3cyclictest0-21swapper/220:00:232
119341992316,5cyclictest123242-21kworker/u8:1+events_unbound19:32:192
119341992316,4cyclictest0-21swapper/223:20:002
119341992316,4cyclictest0-21swapper/223:20:002
119341992315,4cyclictest0-21swapper/223:55:012
119341992314,6cyclictest215536-21fschecks_count23:45:152
119341992313,7cyclictest206894-21grep23:20:152
119339992317,4cyclictest154203-21kworker/u8:2+events_unbound20:52:151
119339992317,4cyclictest154203-21kworker/u8:2+events_unbound20:52:151
119339992316,5cyclictest142438-21kworker/u8:1+events_unbound20:26:331
119339992314,6cyclictest0-21swapper/123:10:151
119339992314,6cyclictest0-21swapper/123:10:151
119339992314,6cyclictest0-21swapper/119:25:251
11933599239,11cyclictest130688-21/usr/sbin/munin19:40:170
119341992216,3cyclictest0-21swapper/222:05:202
119341992216,3cyclictest0-21swapper/220:55:292
119341992216,3cyclictest0-21swapper/220:20:172
119341992216,2cyclictest0-21swapper/219:25:202
11934199221,4cyclictest0-21swapper/221:50:042
119341992214,5cyclictest311ktimers/222:30:262
119341992213,7cyclictest145-21jbd2/mmcblk1p2-800:23:052
119339992216,4cyclictest231ktimers/123:53:311
119339992216,4cyclictest182565-21fschecks_time22:10:181
119339992215,4cyclictest1410742chrt20:10:151
119341992113,5cyclictest0-21swapper/223:40:162
119341992111,7cyclictest140173-21ls20:05:252
119339992113,6cyclictest145486-21sed20:20:261
119339992113,5cyclictest173588-21sed21:45:011
11934199202,5cyclictest131rcu_preempt00:15:112
11934199202,13cyclictest120955-21cron19:15:012
119341992014,3cyclictest0-21swapper/221:10:212
119341992011,6cyclictest0-21swapper/200:25:262
11934199201,14cyclictest169960-21cron21:35:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional