You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 15:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Apr 12, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
797200995647,5cyclictest816512-21munin-plugin-st08:05:011
797196995515,10cyclictest873468-21cat10:50:010
797196995114,21cyclictest867863-21taskset10:32:230
797207994937,8cyclictest814772-21cron08:00:003
797196994938,7cyclictest0-21swapper/009:50:240
797200994842,4cyclictest902975-21kworker/u8:2+events_unbound12:25:251
797196994639,4cyclictest822228-21fschecks_count08:20:170
797196994619,9cyclictest849082-21taskset09:37:140
79720799453,8cyclictest797544-21fschecks_time07:10:173
797203994536,6cyclictest814781-21cron08:00:012
797200994539,4cyclictest871431-21kworker/u8:2+events_unbound10:44:591
79719699459,18cyclictest0-21swapper/011:05:140
797196994516,12cyclictest824025-21basename08:25:170
797207994425,14cyclictest0-21swapper/312:20:003
797196994436,5cyclictest868674-21fschecks_count10:35:170
797196994415,10cyclictest865272-21/usr/sbin/munin10:25:160
79720799433,8cyclictest438-21cron10:20:003
79720799433,7cyclictest818361-21sshd08:09:293
79720799432,9cyclictest802445-21grep07:20:253
79720799432,7cyclictest873418-21cron10:50:013
79720799432,12cyclictest853963-21tail09:50:243
79720799432,11cyclictest896010-21latency_hist11:55:003
79720799432,11cyclictest842938-21fschecks_time09:20:163
79720799432,11cyclictest824756-21sed08:25:253
79720799432,11cyclictest801070-21sshd07:19:203
79720799431,12cyclictest874655-21grep10:50:253
797200994337,4cyclictest897589-21kworker/u8:1+events_unbound12:10:211
79720799423,6cyclictest850265-21wc09:40:233
79720799422,8cyclictest909640-21cron12:35:013
797207994217,20cyclictest0-21swapper/312:05:253
797207994217,20cyclictest0-21swapper/312:05:253
797207994212,3cyclictest0-21swapper/307:30:133
79720799421,13cyclictest859094-21grep10:05:253
79720799421,11cyclictest869535-21grep10:35:273
797207994210,8cyclictest848018-21fschecks_count09:35:173
797207994210,5cyclictest0-21swapper/309:25:253
797207994210,5cyclictest0-21swapper/309:25:253
797200994236,4cyclictest800897-21kworker/u8:3+events_unbound07:29:221
797196994235,3cyclictest875357-21apt-get10:55:110
797196994224,13cyclictest0-21swapper/012:10:110
797196994216,9cyclictest645-21runrttasks12:24:360
797196994216,9cyclictest0-21swapper/007:15:030
79720799415,3cyclictest0-21swapper/311:05:123
79720799412,9cyclictest840313-21tail09:10:243
79720799412,7cyclictest867635-21unixbench_multi10:30:243
79720799412,7cyclictest865918-21tail10:25:243
79720799412,10cyclictest833543-21head08:50:253
79720799411,8cyclictest890877-21cron11:40:003
79720799411,13cyclictest835238-21grep08:55:273
79720799411,10cyclictest893852-21tail11:45:253
797196994122,12cyclictest0-21swapper/007:10:130
797196994122,11cyclictest121ktimers/008:05:120
79720799402,9cyclictest852278-21tail09:45:253
79720799402,8cyclictest910884-21unixbench_multi12:35:263
79720799402,8cyclictest899040-21head12:00:283
79720799402,8cyclictest897289-21head11:55:253
79720799402,7cyclictest907475-21unixbench_multi12:25:243
79720799402,7cyclictest876400-21unixbench_singl10:55:253
79720799402,10cyclictest821357-21grep08:15:253
79720799401,11cyclictest830596-21wc08:45:013
79720799401,10cyclictest860863-21grep10:10:243
797200994034,4cyclictest897589-21kworker/u8:1+events_unbound12:00:201
797200994033,4cyclictest852750-21ls09:50:001
797196994026,11cyclictest854804-21/usr/sbin/munin09:55:140
797196994024,11cyclictest903176-21/usr/sbin/munin12:15:150
797196994021,11cyclictest0-21swapper/010:15:120
797196994018,18cyclictest820122-21munin-run08:15:010
797196994016,9cyclictest878549-21chrt11:02:370
797207993928,8cyclictest832280-21munin-plugin-st08:50:013
79720799391,8cyclictest885326-21tail11:20:253
797207993917,18cyclictest0-21swapper/310:20:253
797207993914,3cyclictest0-21swapper/310:40:243
79720799391,11cyclictest892084-21/usr/sbin/munin11:40:253
79720799391,10cyclictest807965-21munin-run07:40:013
79720799391,10cyclictest804086-21grep07:25:253
797200993933,4cyclictest809382-21kworker/u8:2+events_unbound07:54:271
797200993933,4cyclictest63046-21kworker/u8:1+events_unbound07:14:211
797200993931,5cyclictest853114-21fschecks_count09:50:151
797200993919,6cyclictest131rcu_preempt08:30:141
797196993929,7cyclictest850140-21/usr/sbin/munin09:40:210
797196993928,8cyclictest895244-21/usr/sbin/munin11:50:240
797196993926,10cyclictest846270-21/usr/sbin/munin09:30:130
797196993925,12cyclictest899658-21apt-get12:05:110
797196993925,12cyclictest899658-21apt-get12:05:110
797196993925,10cyclictest803195-21df07:25:140
797196993921,3cyclictest884058-21cron11:20:010
797196993921,11cyclictest0-21swapper/007:20:130
797196993918,7cyclictest890886-21latency_hist11:40:010
79720799388,5cyclictest808411-21fschecks_time07:40:163
79720799383,8cyclictest878340-21head11:00:273
79720799383,7cyclictest836970-21grep09:00:273
79720799383,6cyclictest882763-21fschecks_count11:15:163
79720799383,6cyclictest204-21dbus-daemon12:10:223
79720799382,7cyclictest847612-21cron09:34:593
79720799382,7cyclictest815216-21grep08:00:163
79720799382,10cyclictest886876-21wc11:25:233
797207993814,4cyclictest887827-21sh11:30:113
797207993812,3cyclictest827378-21/usr/sbin/munin08:35:253
79720799381,10cyclictest841214-21fschecks_time09:15:173
797200993832,4cyclictest855881-21kworker/u8:2+events_unbound10:29:561
797200993830,5cyclictest801142-21cron07:20:011
797200993828,6cyclictest0-21swapper/108:30:021
797200993815,5cyclictest131rcu_preempt11:15:131
797196993827,7cyclictest809994-21/usr/sbin/munin07:45:150
797196993825,10cyclictest910633-21/usr/sbin/munin12:35:250
797196993825,10cyclictest870487-21/usr/sbin/munin10:40:160
797196993824,11cyclictest806833-21irqstats07:35:190
797196993824,10cyclictest815266-21/usr/sbin/munin08:00:170
797196993821,4cyclictest834657-21memory08:55:220
797196993821,12cyclictest908806-21ps12:30:220
797207993727,7cyclictest855680-21unixbench_multi09:55:253
797207993714,4cyclictest0-21swapper/311:10:233
797207993713,6cyclictest391ktimers/310:00:113
797207993713,3cyclictest811952-21kernelversion07:50:183
79720799371,10cyclictest826171-21wc08:30:233
797203993728,6cyclictest311ktimers/211:15:132
797200993720,5cyclictest861082-21kworker/u8:0-writeback10:16:111
797196993731,3cyclictest886015-21apt-get11:25:090
797196993730,4cyclictest813425-21df_inode07:55:140
797196993728,7cyclictest843201-21memory09:20:200
797196993727,7cyclictest881018-21/usr/sbin/munin11:10:150
797196993727,7cyclictest820605-21/usr/sbin/munin08:15:150
797196993726,8cyclictest860314-21/usr/sbin/munin10:10:190
797196993726,7cyclictest906922-21/usr/sbin/munin12:25:170
797196993725,9cyclictest891582-21/usr/sbin/munin11:40:190
797196993725,9cyclictest851800-21/usr/sbin/munin09:45:200
797196993725,9cyclictest827500-21diskstats08:35:160
797196993723,11cyclictest899172-21cron12:02:000
797196993719,13cyclictest857396-21grep10:00:240
797196993718,4cyclictest811945-21irqstats07:50:170
79720799369,4cyclictest0-21swapper/309:10:013
79720799362,14cyclictest820106-21cron08:15:013
797203993626,7cyclictest804558-21idleruntime-cro07:30:012
797200993625,4cyclictest131rcu_preempt12:00:011
797200993623,7cyclictest880409-21kworker/u8:1+events_unbound11:25:541
797200993618,11cyclictest131rcu_preempt10:55:201
797196993627,6cyclictest831009-21/usr/sbin/munin08:45:160
797196993626,7cyclictest842461-21sshd09:19:420
797196993626,7cyclictest833020-21/usr/sbin/munin08:50:200
797196993624,9cyclictest889120-21sshd11:34:190
797196993624,9cyclictest844635-21/usr/sbin/munin09:25:160
797196993624,9cyclictest844635-21/usr/sbin/munin09:25:160
797196993624,8cyclictest896343-21df11:55:130
797196993624,8cyclictest825813-21/usr/sbin/munin08:30:180
797196993622,11cyclictest837911-21/usr/sbin/munin09:05:190
79720799352,12cyclictest905856-21head12:20:253
797207993512,5cyclictest391ktimers/307:45:143
79720399354,11cyclictest859892-21expr10:10:132
797203993526,6cyclictest0-21swapper/210:20:002
797203993526,6cyclictest0-21swapper/207:30:252
797200993524,7cyclictest856584-21fschecks_time10:00:151
797200993521,8cyclictest826916-21kworker/u8:1+events_unbound08:55:501
797200993517,5cyclictest131rcu_preempt09:55:251
797200993516,6cyclictest131rcu_preempt10:35:001
797196993529,3cyclictest863223-21apt-get10:20:140
797196993525,7cyclictest892919-21/usr/sbin/munin11:45:130
797196993525,7cyclictest884777-21/usr/sbin/munin11:20:190
797196993525,7cyclictest836043-21diskstats09:00:170
797196993524,8cyclictest874228-21ntp_states10:50:220
797196993524,7cyclictest0-21swapper/007:40:110
797196993521,8cyclictest0-21swapper/008:40:120
797196993520,12cyclictest839453-21/usr/sbin/munin09:10:130
797196993520,11cyclictest805353-21ntp_states07:30:220
797203993425,6cyclictest0-21swapper/209:24:592
797203993424,6cyclictest0-21swapper/208:50:252
797200993421,10cyclictest231ktimers/111:40:131
797200993418,10cyclictest131rcu_preempt08:09:311
797200993416,11cyclictest131rcu_preempt12:15:231
797200993416,11cyclictest131rcu_preempt09:15:011
797200993415,11cyclictest131rcu_preempt09:35:171
797200993414,4cyclictest131rcu_preempt09:27:071
797200993414,4cyclictest131rcu_preempt09:27:071
797196993412,19cyclictest859584-21idleruntime-cro10:10:010
79720399335,10cyclictest846407-21basename09:30:162
79720399334,10cyclictest825496-21cut08:30:022
797203993325,4cyclictest0-21swapper/208:55:262
797203993324,6cyclictest0-21swapper/211:20:252
797203993311,6cyclictest32-21ksoftirqd/208:10:162
797200993327,4cyclictest840515-21kworker/u8:1+events_unbound09:23:411
797200993316,5cyclictest131rcu_preempt09:45:021
797200993316,3cyclictest131rcu_preempt08:11:211
797200993315,5cyclictest131rcu_preempt09:30:181
797200993314,12cyclictest131rcu_preempt08:50:011
797200993312,12cyclictest131rcu_preempt08:25:021
797200993310,19cyclictest231ktimers/111:33:351
797203993225,4cyclictest894309-21kthreadd11:50:002
797203993225,4cyclictest0-21swapper/209:40:142
797203993224,5cyclictest0-21swapper/210:30:162
797203993224,4cyclictest0-21swapper/207:20:262
797203993224,4cyclictest0-21swapper/207:19:202
797203993220,8cyclictest204-21dbus-daemon11:40:152
797200993224,5cyclictest890885-21auditctl11:40:001
797200993223,6cyclictest827543-21fschecks_count08:35:151
797200993221,5cyclictest862955-21kworker/u8:3+events_unbound10:20:011
797200993216,5cyclictest131rcu_preempt11:20:181
797200993216,5cyclictest131rcu_preempt10:50:161
797200993215,5cyclictest131rcu_preempt12:35:011
797200993213,4cyclictest131rcu_preempt11:00:281
797200993213,12cyclictest131rcu_preempt08:40:231
797200993213,11cyclictest131rcu_preempt11:50:211
797200993212,4cyclictest0-21swapper/109:20:011
797200993212,13cyclictest131rcu_preempt10:05:161
797203993123,5cyclictest0-21swapper/211:40:002
797203993119,6cyclictest864284-21unixbench_singl10:20:252
797203993110,4cyclictest32-21ksoftirqd/212:05:192
797203993110,4cyclictest32-21ksoftirqd/212:05:192
797200993124,4cyclictest0-21swapper/109:10:001
797200993119,5cyclictest131rcu_preempt08:50:211
797200993115,4cyclictest131rcu_preempt10:35:241
797200993114,5cyclictest131rcu_preempt10:45:171
797200993112,12cyclictest131rcu_preempt12:20:191
79720399307,6cyclictest0-21swapper/212:15:192
797203993024,3cyclictest0-21swapper/212:00:002
797203993023,4cyclictest0-21swapper/211:00:012
797203993020,6cyclictest0-21swapper/211:30:222
797203993020,6cyclictest0-21swapper/210:04:522
79720099309,12cyclictest24-21ksoftirqd/107:20:261
797200993023,5cyclictest902975-21kworker/u8:2+events_unbound12:37:371
797200993023,4cyclictest0-21swapper/107:49:261
797200993016,5cyclictest131rcu_preempt07:30:261
797200993015,5cyclictest818078-21kworker/u8:2+events_unbound08:17:411
797200993014,9cyclictest131rcu_preempt07:59:271
79720399294,9cyclictest810007-21cstates07:45:152
797203992920,6cyclictest909193-21grep12:30:232
797203992920,6cyclictest0-21swapper/209:25:252
797203992920,6cyclictest0-21swapper/209:25:252
797203992920,6cyclictest0-21swapper/208:05:012
797203992918,8cyclictest808204-21munin-node07:40:112
797203992917,10cyclictest797187-21cyclictest11:50:112
797203992916,7cyclictest131rcu_preempt08:42:442
797203992915,11cyclictest822508-21/usr/sbin/munin08:20:192
797203992910,5cyclictest32-21ksoftirqd/208:05:022
79720099299,4cyclictest131rcu_preempt11:45:251
797200992916,5cyclictest131rcu_preempt07:40:021
797200992915,5cyclictest131rcu_preempt09:00:251
797200992913,5cyclictest131rcu_preempt07:40:171
797203992822,3cyclictest0-21swapper/210:10:012
797203992820,5cyclictest0-21swapper/209:00:172
797203992818,7cyclictest851272-21munin-node09:45:112
797203992816,8cyclictest866373-21sshd10:29:562
797203992814,11cyclictest869130-21/usr/sbin/munin10:35:242
797203992813,9cyclictest797187-21cyclictest07:35:412
79720399281,17cyclictest0-21swapper/208:48:392
797200992812,5cyclictest131rcu_preempt11:05:111
797200992810,11cyclictest131rcu_preempt12:05:241
797200992810,11cyclictest131rcu_preempt12:05:241
79720399279,11cyclictest131rcu_preempt07:13:242
797203992721,3cyclictest839326-21apt-get09:10:112
797203992721,3cyclictest0-21swapper/210:50:012
797203992719,5cyclictest0-21swapper/209:50:202
797203992714,10cyclictest907554-21/usr/sbin/munin12:25:242
797203992714,10cyclictest886471-21/usr/sbin/munin11:25:182
797203992711,11cyclictest0-21swapper/208:35:122
797200992714,5cyclictest131rcu_preempt10:10:191
79720399265,12cyclictest0-21swapper/209:59:382
79720399262,8cyclictest842503-21latency_hist09:20:012
797203992616,7cyclictest820340-21munin-node08:15:112
797203992615,7cyclictest881576-21/usr/sbin/munin11:10:222
797203992615,3cyclictest131rcu_preempt12:00:472
797203992613,9cyclictest813066-21cron07:55:012
797203992613,10cyclictest311ktimers/212:35:132
79720399261,17cyclictest0-21swapper/209:09:362
79720399261,15cyclictest0-21swapper/212:24:062
79720399259,12cyclictest0-21swapper/211:00:132
79720399258,10cyclictest131rcu_preempt08:30:172
797203992519,3cyclictest0-21swapper/210:50:242
797203992516,6cyclictest870698-21/usr/sbin/munin10:40:182
797203992516,5cyclictest0-21swapper/209:35:242
797203992515,7cyclictest901697-21/usr/sbin/munin12:10:172
797203992515,7cyclictest879329-21/usr/sbin/munin11:05:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional