You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 17:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Fri Jul 17, 2026 12:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5464995525,11cyclictest27-21ksoftirqd/209:10:142
544699553,41cyclictest3941-21ssh12:15:140
544699501,41cyclictest31127-21ssh12:30:120
544699471,36cyclictest7647-21ssh10:30:120
5464994615,21cyclictest27-21ksoftirqd/208:35:132
547299448,20cyclictest35966irq/58-eth011:25:133
5464994230,8cyclictest27-21ksoftirqd/211:10:142
547299402,18cyclictest35966irq/58-eth012:35:143
547299402,18cyclictest35966irq/58-eth012:35:143
5464994015,16cyclictest0-21swapper/207:35:132
5464994011,14cyclictest27-21ksoftirqd/212:25:122
5472993912,19cyclictest321rcuc/308:25:143
546499392,18cyclictest27113-21ssh12:10:012
547299383,24cyclictest35966irq/58-eth007:55:143
547299381,25cyclictest35966irq/58-eth009:50:123
546499383,21cyclictest12817-21ssh10:15:162
545699383,22cyclictest23039-21ssh09:45:141
546499377,22cyclictest27-21ksoftirqd/209:35:132
546499372,28cyclictest3707-21ssh10:10:142
5464993715,15cyclictest27-21ksoftirqd/211:25:122
5464993710,23cyclictest0-21swapper/209:40:142
547299363,20cyclictest35966irq/58-eth009:55:143
547299362,19cyclictest35966irq/58-eth009:30:123
5472993614,16cyclictest321rcuc/311:10:143
546499362,27cyclictest31016-21rm12:30:042
544699362,20cyclictest12-21ksoftirqd/012:10:140
547299353,21cyclictest0-21swapper/310:50:143
547299352,20cyclictest35966irq/58-eth012:15:133
545699354,17cyclictest24538-21ssh11:15:121
544699351,27cyclictest16752-21sh10:35:130
544699351,20cyclictest27043-21ssh10:05:150
546499342,27cyclictest23623-21cat11:30:312
545699342,29cyclictest23249-21ssh11:50:131
547299335,12cyclictest35966irq/58-eth010:15:153
547299333,17cyclictest35966irq/58-eth011:05:143
5464993312,15cyclictest5433-21cyclictest08:40:132
544699330,25cyclictest27980-21ssh09:30:130
5456993223,5cyclictest0-21swapper/109:55:141
547299302,17cyclictest35966irq/58-eth010:10:143
546499304,15cyclictest779-21ssh09:15:142
545699304,20cyclictest9888-21ssh09:20:141
545699302,22cyclictest24760-21rm12:07:321
5456993010,10cyclictest21-21ksoftirqd/110:35:131
547299298,11cyclictest0-21swapper/308:45:133
546499292,10cyclictest29197-21usage_EthcTask11:15:302
547299283,16cyclictest0-21swapper/309:38:323
546499282,21cyclictest28072-21ssh11:50:312
546499282,16cyclictest27346irq/40-dwc2_hso08:55:142
546499282,10cyclictest26456-21ssh12:09:302
545699282,21cyclictest12195-21sh09:38:321
544699282,19cyclictest18647-21cat09:40:310
5446992815,4cyclictest12-21ksoftirqd/007:30:130
547299273,16cyclictest0-21swapper/311:15:313
547299273,15cyclictest0-21swapper/312:30:053
547299273,15cyclictest0-21swapper/309:40:313
5472992713,8cyclictest35966irq/58-eth010:25:153
547299271,13cyclictest35966irq/58-eth009:10:123
546499273,18cyclictest27346irq/40-dwc2_hso07:25:132
546499273,18cyclictest27346irq/40-dwc2_hso07:25:122
546499273,16cyclictest27346irq/40-dwc2_hso07:15:132
546499272,20cyclictest0-21swapper/207:30:142
545699272,19cyclictest20721-21ssh11:47:321
544699272,19cyclictest21269-21ssh12:24:320
5472992613,8cyclictest321rcuc/307:40:133
546499269,13cyclictest3939-21/usr/sbin/munin11:55:292
546499265,7cyclictest131rcu_preempt08:00:142
546499261,9cyclictest32107-21ssh09:50:132
545699264,16cyclictest1916-21kworker/u8:110:50:151
544699261,19cyclictest669-21ssh11:19:560
544699261,19cyclictest6034-21users11:20:310
544699261,16cyclictest23675-21diskmemload11:30:140
5472992510,9cyclictest35966irq/58-eth012:00:123
546499255,12cyclictest27346irq/40-dwc2_hso08:20:122
546499252,18cyclictest9629-21ssh12:16:312
546499251,18cyclictest7695-21ssh12:35:062
546499251,18cyclictest7695-21ssh12:35:062
546499250,18cyclictest10349-21ls07:45:282
545699254,15cyclictest13035-21ssh12:20:121
545699253,18cyclictest29783-21ssh11:00:141
5456992513,8cyclictest0-21swapper/107:20:141
544699256,11cyclictest12-21ksoftirqd/008:55:140
544699252,17cyclictest25860-21ssh10:40:130
544699252,17cyclictest25860-21ssh10:40:120
544699251,17cyclictest8562-21apt-get12:00:040
547299249,11cyclictest0-21swapper/310:05:313
547299247,11cyclictest0-21swapper/311:24:313
547299243,15cyclictest0-21swapper/311:45:133
547299243,11cyclictest0-21swapper/311:40:153
547299242,15cyclictest35966irq/58-eth012:05:143
546499245,13cyclictest0-21swapper/209:00:122
546499245,13cyclictest0-21swapper/209:00:122
546499242,18cyclictest9764-21ssh11:24:562
546499242,17cyclictest0-21swapper/209:47:312
546499242,15cyclictest27-21ksoftirqd/208:25:132
546499242,13cyclictest27047-21ssh10:05:152
546499240,21cyclictest15156-21find07:20:132
545699242,17cyclictest13915-21ssh09:40:141
5456992411,7cyclictest0-21swapper/109:30:311
544699243,18cyclictest0-21swapper/011:25:120
544699241,13cyclictest2448-21ssh10:45:130
547299233,11cyclictest0-21swapper/312:10:153
5472992311,7cyclictest35966irq/58-eth011:55:133
546499234,14cyclictest27346irq/40-dwc2_hso08:45:122
546499234,11cyclictest27346irq/40-dwc2_hso08:10:122
546499234,11cyclictest27346irq/40-dwc2_hso08:10:122
546499233,16cyclictest27346irq/40-dwc2_hso12:20:122
546499233,16cyclictest27346irq/40-dwc2_hso10:25:142
546499233,13cyclictest27346irq/40-dwc2_hso08:05:172
546499233,13cyclictest21832-21ssh10:20:142
546499232,6cyclictest0-21swapper/209:34:312
546499232,16cyclictest0-21swapper/211:49:302
546499232,16cyclictest0-21swapper/209:23:322
546499232,15cyclictest0-21swapper/212:00:042
5464992316,4cyclictest9318-21sh11:40:322
546499231,10cyclictest32251-21kthreadcore11:00:222
544699239,9cyclictest12-21ksoftirqd/011:50:110
544699231,17cyclictest5151-21ssh11:40:150
547299222,12cyclictest0-21swapper/310:35:123
547299222,10cyclictest35966irq/58-eth010:55:133
5472992212,7cyclictest0-21swapper/309:18:233
546499225,14cyclictest18395-21kthreadcore08:30:212
546499222,15cyclictest0-21swapper/209:25:302
546499222,14cyclictest0-21swapper/207:55:142
546499222,13cyclictest27346irq/40-dwc2_hso10:50:132
546499221,6cyclictest0-21swapper/210:30:142
546499221,18cyclictest48-21kcompactd009:55:172
5464992211,8cyclictest20597-21/usr/sbin/munin10:55:202
545699227,11cyclictest21-21ksoftirqd/111:56:311
544699221,17cyclictest11529-21ssh10:50:150
547299215,11cyclictest0-21swapper/311:31:313
547299212,12cyclictest0-21swapper/311:35:133
547299212,10cyclictest0-21swapper/310:20:153
547299211,13cyclictest0-21swapper/309:25:133
546499219,10cyclictest16755-21cpu10:35:142
546499213,9cyclictest4060-21kthreadcore08:15:212
546499213,16cyclictest13261-21kthreadcore07:50:212
546499213,10cyclictest2219-21latency_hist10:45:022
546499213,10cyclictest2219-21latency_hist10:45:022
546499212,12cyclictest27346irq/40-dwc2_hso07:10:132
5464992111,8cyclictest19425-21irqcore09:05:182
546499211,16cyclictest4666-21fschecks_count08:50:182
546499211,11cyclictest2828-21irqcore10:45:192
5464992110,8cyclictest0-21swapper/211:35:282
545699212,7cyclictest131rcu_preempt07:40:011
545699212,10cyclictest2908-21kthreadcore07:40:201
5456992114,4cyclictest13904-21sh11:25:241
5456992113,5cyclictest19231-21ntp_states11:10:281
544699212,2cyclictest131rcu_preempt09:50:110
544699212,14cyclictest4265-21ssh11:55:310
544699212,14cyclictest18156-21sh09:24:330
544699211,5cyclictest0-21swapper/008:20:010
5446992112,6cyclictest23295-21tune2fs09:45:180
5446992111,7cyclictest7353-21ntp_192.168.11410:10:260
544699211,17cyclictest28432-21ssh11:35:130
544699211,16cyclictest7828-21ssh12:35:140
544699211,16cyclictest7828-21ssh12:35:140
544699211,16cyclictest6489-21ssh11:05:140
544699211,16cyclictest30989-21ssh10:25:150
547299203,14cyclictest35966irq/58-eth007:20:133
547299203,11cyclictest0-21swapper/312:25:063
547299202,12cyclictest321rcuc/310:30:113
547299202,12cyclictest0-21swapper/311:50:123
546499201,9cyclictest8455-21kthreadcore11:05:232
546499200,10cyclictest17979-21cpu10:00:132
545699202,13cyclictest23675-21diskmemload12:04:321
5456992015,3cyclictest12816-21ssh10:15:151
5456992014,3cyclictest21-21ksoftirqd/108:25:111
545699201,17cyclictest0-21swapper/110:40:121
545699201,17cyclictest0-21swapper/110:40:121
545699201,16cyclictest3186-21ls09:50:231
5456992011,6cyclictest30568-21cron10:25:011
545699201,15cyclictest9371-21apt-get08:55:131
545699201,15cyclictest5160-21sh11:40:141
5456992010,7cyclictest21-21ksoftirqd/112:35:141
5456992010,7cyclictest21-21ksoftirqd/112:35:131
545699200,16cyclictest3901-21find12:15:111
544699201,15cyclictest14147-21ssh11:45:140
544699201,14cyclictest20640-21ssh10:55:140
547299199,7cyclictest321rcuc/310:00:113
547299199,3cyclictest0-21swapper/310:47:583
547299193,9cyclictest0-21swapper/309:24:323
547299192,12cyclictest0-21swapper/312:20:313
547299192,10cyclictest0-21swapper/308:30:153
547299192,10cyclictest0-21swapper/307:50:153
5472991911,6cyclictest0-21swapper/309:50:023
547299191,13cyclictest0-21swapper/308:15:243
547299191,12cyclictest0-21swapper/307:10:163
546499192,14cyclictest2057-21fschecks_count07:40:162
545699199,7cyclictest6803-21cat10:45:321
545699192,9cyclictest14267-21/usr/sbin/munin09:00:251
545699192,9cyclictest14267-21/usr/sbin/munin09:00:241
5456991912,4cyclictest31516-21interrupts12:30:171
5456991911,6cyclictest19699-21ssh11:30:181
5456991911,5cyclictest31433-21usage_Anybus10:05:321
545699191,15cyclictest24098-21ssh09:10:131
545699191,14cyclictest27386-21apt-get08:40:131
544699191,4cyclictest31777-21cat11:00:220
544699191,15cyclictest11366-21ls07:50:020
544699191,14cyclictest4770-21ssh09:35:130
544699191,11cyclictest20170-21timerwakeupswit07:55:290
544699191,10cyclictest17773-21fschecks_time08:30:170
547299189,6cyclictest0-21swapper/307:35:163
547299188,6cyclictest0-21swapper/311:03:473
547299182,10cyclictest0-21swapper/308:35:053
547299182,10cyclictest0-21swapper/307:45:143
547299181,13cyclictest0-21swapper/309:05:243
5472991810,6cyclictest0-21swapper/310:42:433
5472991810,6cyclictest0-21swapper/310:42:433
545699189,7cyclictest32135-21users12:10:311
545699189,5cyclictest22649-21kthreadcore10:55:241
545699181,8cyclictest20096-21fschecks_count07:25:161
545699181,8cyclictest20096-21fschecks_count07:25:151
5456991812,4cyclictest21662-21sh10:00:281
545699181,14cyclictest32244-21uname11:35:271
5456991811,4cyclictest0-21swapper/107:10:181
545699181,11cyclictest19746-21missed_timers07:55:241
5456991810,6cyclictest16562-21date10:35:021
544699185,3cyclictest131rcu_preempt09:26:470
544699183,10cyclictest0-21swapper/007:20:150
544699182,4cyclictest131rcu_preempt11:10:220
544699182,13cyclictest10107-21grep07:15:010
544699181,9cyclictest0-21swapper/009:15:310
544699181,7cyclictest23680-21apt09:10:010
5446991811,5cyclictest13051-21idleruntime08:25:170
5446991811,5cyclictest0-21swapper/008:00:210
544699181,13cyclictest18191-21ssh12:05:120
544699181,11cyclictest22379-21usage_Anybus10:00:310
544699181,11cyclictest21958-21ssh12:25:060
544699181,11cyclictest16281-21missed_timers10:15:260
547299172,10cyclictest0-21swapper/308:55:153
547299171,13cyclictest0-21swapper/308:20:163
545699179,6cyclictest9712-21cut11:05:231
545699179,6cyclictest7034-21unixbench_singl08:15:301
545699179,6cyclictest2923-21cat10:25:321
545699179,5cyclictest2850-21kthreadcore08:45:211
545699177,7cyclictest3712-21ssh10:10:141
545699177,7cyclictest21-21ksoftirqd/108:40:011
545699175,9cyclictest10092-21missed_timers07:45:231
545699175,4cyclictest0-21swapper/109:10:011
545699172,12cyclictest22192-21df_inode12:25:141
5456991711,3cyclictest4652-21switchtime09:15:311
545699171,13cyclictest16202-21date07:55:011
545699171,12cyclictest1188-21apt-get11:20:131
545699171,12cyclictest10427-21diskstats07:15:161
5456991710,5cyclictest20089-21kthreadcore09:25:191
544699179,6cyclictest20147-21tune2fs07:25:160
544699179,6cyclictest20147-21tune2fs07:25:150
544699178,6cyclictest18859-21cron09:05:010
544699178,6cyclictest18859-21cron09:05:000
544699176,9cyclictest28736-21kthreadcore08:05:240
5446991711,4cyclictest27597-21hwlatdetect08:40:160
5446991710,5cyclictest14890-21sshd07:16:300
547299162,10cyclictest0-21swapper/308:40:143
545699168,6cyclictest21076-21ntpq08:30:281
545699161,12cyclictest30810-21find08:10:111
545699161,12cyclictest30810-21find08:10:101
545699161,12cyclictest21563-21cut08:00:201
5456991610,4cyclictest29016-21kthreadcore08:05:251
5456991610,3cyclictest4882-21irqcore08:50:201
544699167,7cyclictest22081-21fw_packets10:20:160
544699166,7cyclictest614-21dbus-daemon07:54:120
544699165,8cyclictest29612-21df_inode07:35:150
544699161,8cyclictest23457-21kthreadcore08:35:200
544699161,5cyclictest9177-21latency_hist08:55:010
544699161,12cyclictest8395-21apt-get09:55:050
544699161,11cyclictest26662-21tr09:10:220
544699160,11cyclictest2600-21kthreadcore07:40:200
547299159,4cyclictest0-21swapper/308:50:193
547299154,6cyclictest0-21swapper/307:25:143
547299154,6cyclictest0-21swapper/307:25:143
547299152,9cyclictest321rcuc/307:30:133
547299152,10cyclictest0-21swapper/308:10:153
547299152,10cyclictest0-21swapper/308:10:153
545699151,11cyclictest8035-21cpu08:20:141
545699151,11cyclictest25795-21kthreadcore07:30:201
544699152,10cyclictest8471-21irqcore08:20:180
544699152,10cyclictest30819-21apt-get08:10:110
544699152,10cyclictest30819-21apt-get08:10:100
547299149,3cyclictest0-21swapper/307:15:183
547299143,6cyclictest0-21swapper/308:05:163
547299141,7cyclictest0-21swapper/309:00:133
547299141,7cyclictest0-21swapper/309:00:133
546499147,5cyclictest5477-21latency_hist07:10:022
544699141,10cyclictest32192-21apt-get08:45:120
545699131,9cyclictest5331-21latency_hist07:10:021
544699131,9cyclictest5523-21latency_hist07:10:010
547299122,7cyclictest0-21swapper/308:00:183
547299111,7cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional