You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 06:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon Dec 29, 2025 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
445239995125,23cyclictest391ktimers/323:55:123
445235994840,4cyclictest464958-21munin-plugin-st20:05:012
445230994834,11cyclictest231ktimers/120:25:121
44522699471,5cyclictest499846-21irqstats21:45:210
445226994535,7cyclictest461229-21latency_hist19:55:010
445226994527,15cyclictest0-21swapper/023:10:260
445226994514,25cyclictest13550irq/42-30be0000.ethernet21:55:120
44522699451,11cyclictest550470-21users00:10:280
445226994435,6cyclictest512504-21unixbench_singl22:20:250
445226994435,6cyclictest512504-21unixbench_singl22:20:250
445235994334,6cyclictest311ktimers/221:25:152
445235994332,7cyclictest476657-21grep20:35:282
445226994330,9cyclictest492002-21grep21:20:260
445226994313,27cyclictest0-21swapper/022:35:050
44522699431,10cyclictest552824-21apt-get00:20:130
445239994230,9cyclictest391ktimers/322:55:173
445235994235,4cyclictest511212-21sh22:20:012
445235994235,4cyclictest511212-21sh22:20:002
445235994232,7cyclictest311ktimers/222:10:142
445226994233,6cyclictest490727-21cron21:20:010
445239994135,3cyclictest507802-21ls22:10:003
445239994119,4cyclictest0-21swapper/321:25:183
445235994133,6cyclictest311ktimers/223:15:122
445235994130,8cyclictest522903-21grep22:50:232
44522699419,6cyclictest557288-21grep00:30:260
44522699411,9cyclictest515931-21users22:30:260
445226994113,25cyclictest555149-21ps00:25:230
445226994111,27cyclictest0-21swapper/020:35:270
445235994029,7cyclictest467944-21grep20:10:292
44522699403,10cyclictest506774-21meminfo22:05:190
445226994016,20cyclictest540599-21date23:45:000
445226994015,21cyclictest0-21swapper/019:20:250
445226994012,3cyclictest522096-21fschecks_time22:50:140
44522699401,12cyclictest545771-21awk23:59:590
44522699401,12cyclictest485975-21diskstats21:05:180
44522699401,10cyclictest482879-21/usr/sbin/munin20:55:210
44522699398,6cyclictest542637-21cat23:50:170
44522699398,6cyclictest542637-21cat23:50:160
44522699397,5cyclictest477712-21cat20:40:170
44522699392,9cyclictest538697-21cron23:40:000
445226993926,9cyclictest121ktimers/021:10:140
445226993917,19cyclictest454290-21munin-plugin-st19:35:020
445226993914,22cyclictest0-21swapper/020:00:020
445226993912,2cyclictest0-21swapper/023:19:350
44522699391,11cyclictest558515-21ntp_states00:35:240
44522699391,11cyclictest505701-21users22:00:260
44522699391,11cyclictest481175-21meminfo20:50:180
44522699391,10cyclictest498348-21/usr/sbin/munin21:40:200
445235993826,8cyclictest526301-21grep23:00:292
44522699389,4cyclictest526300-21grep23:00:300
44522699382,9cyclictest524273-21/usr/sbin/munin22:55:280
44522699382,7cyclictest447062-21grep19:15:020
44522699382,10cyclictest519965-21grep22:45:000
445226993812,2cyclictest0-21swapper/000:00:170
445226993812,23cyclictest0-21swapper/019:35:240
445226993811,2cyclictest0-21swapper/023:25:340
44522699381,11cyclictest467441-21ntp_states20:10:220
445239993729,4cyclictest0-21swapper/321:35:173
445235993726,8cyclictest481730-21grep20:50:242
44522699378,6cyclictest466120-21timerwakeupswit20:05:250
44522699377,5cyclictest508106-21cpuspeed22:10:160
44522699371,8cyclictest472132-21/usr/sbin/munin20:25:170
44522699371,8cyclictest471757-21cron20:25:010
44522699371,7cyclictest452127-21tail19:25:250
44522699371,3cyclictest552648-21latency_hist00:20:020
445226993713,3cyclictest527172-21fschecks_count23:05:160
44522699371,2cyclictest0-21swapper/019:15:020
445226993711,23cyclictest0-21swapper/019:40:190
44522699371,11cyclictest468692-21df_inode20:15:170
44522699371,10cyclictest520595-21cat22:45:190
44522699371,10cyclictest497579-21awk21:40:000
445239993628,5cyclictest471770-21kthreadd20:25:003
445239993625,8cyclictest466171-21grep20:05:253
445235993625,7cyclictest529734-21grep23:10:272
445230993615,4cyclictest0-21swapper/120:15:221
44522699369,5cyclictest463860-21ls20:00:200
44522699369,24cyclictest0-21swapper/022:20:020
44522699369,24cyclictest0-21swapper/022:20:010
445226993621,11cyclictest121ktimers/023:30:170
44522699361,6cyclictest494146-21cron21:30:000
445226993615,19cyclictest13550irq/42-30be0000.ethernet20:45:140
44522699361,11cyclictest494950-21ntp_states21:30:210
44522699361,10cyclictest547827-21grep00:05:150
445239993527,4cyclictest0-21swapper/319:15:273
445235993527,4cyclictest0-21swapper/200:30:272
445235993526,4cyclictest0-21swapper/221:45:282
445235993525,6cyclictest469573-21grep20:15:282
445235993523,8cyclictest527999-21grep23:05:262
445235993523,7cyclictest457228-21grep19:40:292
445230993525,5cyclictest0-21swapper/123:35:151
445230993520,7cyclictest131rcu_preempt22:00:251
44522699351,9cyclictest513702-21tr22:25:210
44522699351,8cyclictest485198-21grep21:00:280
44522699351,6cyclictest502205-21unixbench_multi21:50:260
44522699351,11cyclictest458069-21forks19:45:160
445239993424,7cyclictest529758-21grep23:10:263
445239993424,6cyclictest0-21swapper/300:25:263
445235993425,5cyclictest453881-21grep19:30:252
445235993425,5cyclictest446967-21latency_hist19:15:012
445235993422,8cyclictest0-21swapper/220:55:262
445230993427,4cyclictest456007-21sendmail19:40:011
445239993327,3cyclictest531886-21kthreadd23:20:003
445239993325,4cyclictest0-21swapper/322:10:273
445239993323,6cyclictest0-21swapper/323:40:003
445230993325,5cyclictest487327-21munin-run21:10:001
445230993325,4cyclictest0-21swapper/122:12:511
445226993324,6cyclictest0-21swapper/020:30:150
44522699332,10cyclictest533604-21auditctl23:25:000
445226993311,3cyclictest542531-21latency_hist23:50:010
445226993311,3cyclictest542531-21latency_hist23:50:000
445239993224,5cyclictest458938-21unixbench_multi19:45:263
445239993222,7cyclictest514199-21grep22:25:253
445239993221,7cyclictest0-21swapper/300:35:003
445239993221,6cyclictest0-21swapper/320:35:263
445239993220,8cyclictest550435-21grep00:10:263
445235993223,5cyclictest0-21swapper/222:40:262
445235993223,5cyclictest0-21swapper/200:35:192
445235993223,4cyclictest0-21swapper/223:45:192
445235993223,4cyclictest0-21swapper/223:45:192
445235993223,4cyclictest0-21swapper/222:35:002
445235993221,7cyclictest0-21swapper/221:15:262
44523099325,6cyclictest24-21ksoftirqd/122:30:231
445230993223,5cyclictest0-21swapper/123:55:161
445230993223,4cyclictest0-21swapper/119:45:271
445239993123,4cyclictest0-21swapper/321:50:013
445239993122,6cyclictest539958-21unixbench_multi23:40:253
445239993122,6cyclictest502239-21unixbench_singl21:50:283
445239993121,6cyclictest528024-21grep23:05:263
445239993121,6cyclictest0-21swapper/323:45:283
445239993121,6cyclictest0-21swapper/323:45:283
445239993121,6cyclictest0-21swapper/320:15:283
445239993121,6cyclictest0-21swapper/319:40:193
445239993121,6cyclictest0-21swapper/300:15:263
445235993125,3cyclictest525063-21kthreadd23:00:002
445235993124,4cyclictest0-21swapper/221:05:302
445235993121,7cyclictest311ktimers/221:30:132
445235993121,6cyclictest0-21swapper/219:50:022
445235993117,10cyclictest311ktimers/221:00:152
44523099319,8cyclictest24-21ksoftirqd/121:10:201
44523099315,6cyclictest24-21ksoftirqd/123:15:171
44523099315,5cyclictest24-21ksoftirqd/123:30:241
445230993123,4cyclictest0-21swapper/121:40:251
445230993122,5cyclictest494598-21grep21:30:161
445230993121,5cyclictest0-21swapper/122:05:171
445239993023,4cyclictest391ktimers/300:20:143
445239993022,5cyclictest0-21swapper/320:50:253
445239993020,6cyclictest0-21swapper/322:40:253
445239993020,6cyclictest0-21swapper/322:15:183
445239993020,6cyclictest0-21swapper/322:15:173
445239993020,6cyclictest0-21swapper/319:32:213
445239993018,7cyclictest0-21swapper/323:20:263
445235993020,6cyclictest0-21swapper/220:20:282
445235993019,8cyclictest548723-21grep00:05:252
44523099306,8cyclictest24-21ksoftirqd/120:35:171
44523099304,8cyclictest24-21ksoftirqd/122:55:281
445230993024,4cyclictest221rcuc/122:51:581
445230993014,3cyclictest131rcu_preempt19:55:201
445239992922,4cyclictest523352-21cron22:55:003
445239992922,4cyclictest0-21swapper/322:00:003
445239992921,5cyclictest0-21swapper/323:00:303
445239992917,7cyclictest0-21swapper/320:45:263
445235992922,4cyclictest0-21swapper/223:20:262
445235992922,3cyclictest0-21swapper/220:35:012
445235992921,5cyclictest0-21swapper/223:54:592
445235992921,5cyclictest0-21swapper/223:54:592
445235992918,7cyclictest505628-21grep22:00:272
44523099296,7cyclictest24-21ksoftirqd/123:05:001
44523099296,7cyclictest24-21ksoftirqd/119:35:011
44523099296,5cyclictest24-21ksoftirqd/123:50:241
44523099296,5cyclictest24-21ksoftirqd/123:50:241
445230992921,4cyclictest452585-21idleruntime-cro19:30:021
445230992920,5cyclictest0-21swapper/120:45:271
445230992912,4cyclictest131rcu_preempt00:05:121
445230992910,4cyclictest131rcu_preempt00:00:161
445230992910,12cyclictest131rcu_preempt23:25:171
445239992822,3cyclictest0-21swapper/320:40:243
445239992818,7cyclictest0-21swapper/320:55:283
445239992818,6cyclictest0-21swapper/300:09:593
445235992820,5cyclictest0-21swapper/219:55:172
445235992820,4cyclictest518239-21latency_hist22:40:002
445235992819,6cyclictest0-21swapper/220:25:252
445235992817,6cyclictest0-21swapper/200:00:002
44523099288,5cyclictest131rcu_preempt21:25:131
44523099287,7cyclictest24-21ksoftirqd/119:55:021
44523099287,7cyclictest24-21ksoftirqd/100:30:211
44523099285,6cyclictest24-21ksoftirqd/122:35:231
44523099285,5cyclictest24-21ksoftirqd/120:35:011
44523099284,6cyclictest24-21ksoftirqd/122:25:011
44523099284,6cyclictest24-21ksoftirqd/122:25:001
445230992820,4cyclictest0-21swapper/121:55:251
445230992818,7cyclictest231ktimers/119:17:431
445230992816,5cyclictest131rcu_preempt19:10:241
445230992810,4cyclictest131rcu_preempt23:22:431
445239992717,6cyclictest0-21swapper/319:50:263
445239992716,7cyclictest516329-21ls22:35:013
445239992716,7cyclictest0-21swapper/320:15:003
445235992719,5cyclictest0-21swapper/219:25:252
445235992719,4cyclictest0-21swapper/220:05:172
445235992718,6cyclictest455531-21grep19:35:242
445235992718,6cyclictest0-21swapper/200:15:252
445235992717,7cyclictest461185-21ls19:55:012
44523099277,6cyclictest0-21swapper/121:20:261
44523099274,9cyclictest24-21ksoftirqd/121:15:201
44523099274,6cyclictest24-21ksoftirqd/121:54:291
445230992719,5cyclictest0-21swapper/121:05:001
445230992719,4cyclictest0-21swapper/123:40:251
445230992719,4cyclictest0-21swapper/100:20:271
445230992718,4cyclictest0-21swapper/121:40:011
445239992616,7cyclictest485616-21cron21:05:003
445239992616,7cyclictest0-21swapper/320:00:263
445239992616,6cyclictest0-21swapper/322:45:263
445239992616,6cyclictest0-21swapper/321:15:003
445239992616,6cyclictest0-21swapper/300:35:293
445239992613,9cyclictest204-21dbus-daemon23:53:263
445239992613,9cyclictest204-21dbus-daemon23:53:263
445235992620,3cyclictest0-21swapper/221:40:002
445235992619,3cyclictest0-21swapper/222:45:262
445235992614,8cyclictest0-21swapper/200:20:272
44523099265,7cyclictest24-21ksoftirqd/120:05:011
44523099264,7cyclictest24-21ksoftirqd/120:45:021
44523099264,6cyclictest24-21ksoftirqd/122:45:261
44523099263,6cyclictest24-21ksoftirqd/120:55:191
445230992618,5cyclictest0-21swapper/120:20:191
445230992617,5cyclictest0-21swapper/100:27:391
445230992615,4cyclictest131rcu_preempt20:06:191
445230992611,8cyclictest131rcu_preempt00:10:191
445230992610,9cyclictest131rcu_preempt19:24:321
445230992610,5cyclictest131rcu_preempt20:11:011
445239992517,5cyclictest455988-21munin-run19:40:023
445239992516,5cyclictest0-21swapper/322:35:263
445239992514,6cyclictest463224-21gpgv20:00:013
44523999251,3cyclictest0-21swapper/319:12:303
445235992519,3cyclictest0-21swapper/219:15:252
445235992518,4cyclictest0-21swapper/223:35:252
445235992518,4cyclictest0-21swapper/200:10:262
445235992517,5cyclictest0-21swapper/222:20:162
445235992517,5cyclictest0-21swapper/222:20:152
445235992517,4cyclictest0-21swapper/200:25:172
445235992514,7cyclictest0-21swapper/219:20:162
445235992511,10cyclictest311ktimers/222:05:132
44523099257,6cyclictest24-21ksoftirqd/123:10:171
44523099256,6cyclictest24-21ksoftirqd/100:35:151
44523099256,3cyclictest231ktimers/119:43:341
44523099253,7cyclictest24-21ksoftirqd/120:55:011
44523099251,7cyclictest24-21ksoftirqd/123:45:021
44523099251,7cyclictest24-21ksoftirqd/123:45:021
445230992516,6cyclictest231ktimers/122:29:031
445230992514,4cyclictest131rcu_preempt22:15:201
445230992514,4cyclictest131rcu_preempt22:15:201
445230992513,3cyclictest131rcu_preempt23:05:041
445230992512,4cyclictest131rcu_preempt00:18:271
445230992510,5cyclictest131rcu_preempt22:44:191
445239992418,3cyclictest0-21swapper/323:25:213
445239992418,3cyclictest0-21swapper/320:30:013
445239992414,7cyclictest0-21swapper/321:30:253
445239992412,5cyclictest546073-21cpuspeed00:00:133
445235992414,6cyclictest0-21swapper/221:10:272
445235992412,9cyclictest311ktimers/223:25:132
445230992416,5cyclictest0-21swapper/121:45:281
445239992317,3cyclictest0-21swapper/321:20:263
445239992317,3cyclictest0-21swapper/321:15:163
445239992316,4cyclictest0-21swapper/319:25:253
445239992315,4cyclictest0-21swapper/322:20:253
445239992315,4cyclictest0-21swapper/322:20:253
445239992313,7cyclictest0-21swapper/319:25:003
445235992316,4cyclictest645-21runrttasks21:20:242
445239992214,5cyclictest0-21swapper/323:35:013
445239992213,6cyclictest486386-21ntpq21:05:243
44523599222,8cyclictest480036-21grep20:45:262
445235992216,3cyclictest539167-21fschecks_time23:40:172
445235992212,6cyclictest0-21swapper/221:50:262
445239992115,3cyclictest0-21swapper/320:30:263
445239992114,4cyclictest0-21swapper/322:00:263
445235992114,4cyclictest503605-21mailstats21:55:242
445235992113,5cyclictest477530-21tune2fs20:40:152
445235992111,7cyclictest535542-21apt-get23:30:152
445239992011,6cyclictest0-21swapper/321:40:203
445235992013,4cyclictest498806-21unixbench_multi21:40:242
445235991914,3cyclictest545989-21/usr/sbin/munin00:00:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional