You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 18:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Thu Jul 23, 2026 12:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
72999623,43cyclictest5502-21ssh11:25:131
72999604,51cyclictest23371-21ssh09:30:141
74199562,41cyclictest6712-21ssh10:50:132
72999531,43cyclictest26009-21ssh12:30:111
72199512,32cyclictest30054-21ssh10:45:130
72199511,43cyclictest7884-21apt-get12:20:120
74199492,21cyclictest15801-21ssh10:55:132
74199492,21cyclictest15801-21ssh10:55:132
72199491,43cyclictest0-21swapper/009:30:150
72999482,35cyclictest9388-21ssh11:45:131
72999481,38cyclictest26192-21ssh10:25:141
72999477,5cyclictest131rcu_preempt12:35:101
72199471,42cyclictest0-21swapper/011:15:130
72999462,36cyclictest24926-21ssh11:00:131
72199463,28cyclictest14575-21ssh11:30:130
72199462,39cyclictest0-21swapper/008:55:150
72199462,38cyclictest32211-21apt-get08:50:130
72199461,41cyclictest6886-21apt-get07:50:120
72199461,37cyclictest0-21swapper/010:20:120
74999453,26cyclictest35966irq/58-eth011:35:133
74999442,24cyclictest35966irq/58-eth010:50:143
72999442,35cyclictest4070-21ssh09:55:111
729994423,10cyclictest21-21ksoftirqd/110:30:131
729994419,19cyclictest21-21ksoftirqd/110:05:121
72999441,31cyclictest27450-21ssh11:55:131
72199443,31cyclictest26201-21ssh10:25:130
72199442,38cyclictest15327-21apt-get07:25:130
729994235,4cyclictest211ksoftirqd/110:55:121
729994235,4cyclictest211ksoftirqd/110:55:111
72199421,35cyclictest32456-21apt-get09:35:120
72199420,27cyclictest3307-21cat12:15:300
74999414,23cyclictest35966irq/58-eth010:00:123
749994124,12cyclictest0-21swapper/310:05:103
74199412,3cyclictest0-21swapper/209:35:122
74199412,24cyclictest13132-21ssh12:05:152
729994119,15cyclictest21-21ksoftirqd/111:05:131
72999411,10cyclictest131rcu_preempt09:35:121
72199412,32cyclictest8010-21ssh10:15:130
72199411,34cyclictest8189-21apt-get08:25:140
72199411,25cyclictest14411-21ssh11:45:410
72199410,29cyclictest22726-21ssh10:57:560
72199410,29cyclictest22726-21ssh10:57:550
72199401,34cyclictest2105-21apt-get07:45:130
72199401,34cyclictest0-21swapper/010:35:120
72199401,25cyclictest15368-21awk07:55:280
74999392,25cyclictest35966irq/58-eth012:35:123
74199392,24cyclictest28830-21ssh11:20:122
72199391,35cyclictest27356-21ssh09:50:120
72199391,2cyclictest0-21swapper/008:40:110
72199381,30cyclictest28827-21apt-get11:20:130
72199380,3cyclictest29703-21apt-get07:40:140
72199380,24cyclictest26097-21ssh09:49:000
74999372,18cyclictest35966irq/58-eth010:25:133
72199373,31cyclictest13117-21ssh12:05:140
72199371,31cyclictest22130-21apt-get10:05:100
72199371,30cyclictest0-21swapper/012:00:130
72199370,30cyclictest2788-21ssh10:30:130
72999364,22cyclictest19334-21ssh09:10:131
72199361,31cyclictest31859-21cut10:10:180
72199361,31cyclictest31859-21cut10:10:180
72199361,31cyclictest27400-21/usr/sbin/munin11:55:220
72199361,31cyclictest17799-21grep12:25:180
72199361,31cyclictest0-21swapper/009:20:130
72199361,30cyclictest3414-21apt-get08:20:130
721993612,21cyclictest18420-21apt11:50:120
72199360,4cyclictest23634-21apt-get11:35:120
72199360,30cyclictest20967-21apt-get10:40:130
72199360,24cyclictest1153-21ssh12:33:390
74999354,19cyclictest35966irq/58-eth011:30:123
72999354,6cyclictest131rcu_preempt09:50:131
72199352,30cyclictest0-21swapper/011:25:120
72199351,30cyclictest19343-21ssh09:10:140
72199351,30cyclictest10587-21/usr/sbin/munin11:10:240
72199350,4cyclictest2678-21apt-get12:35:120
74999346,25cyclictest35966irq/58-eth010:45:133
74199343,8cyclictest0-21swapper/212:28:262
729993423,7cyclictest211ksoftirqd/110:00:131
72199342,29cyclictest0-21swapper/009:15:120
72199341,29cyclictest24908-21apt-get11:00:130
72199341,29cyclictest13154-21apt-get10:00:140
72199341,29cyclictest10414-21cut09:40:190
72199341,24cyclictest12583-21ssh10:51:450
72199341,22cyclictest0-21swapper/009:25:190
74999336,17cyclictest35966irq/58-eth010:35:123
74999332,17cyclictest35966irq/58-eth010:10:133
74999332,17cyclictest35966irq/58-eth010:10:123
72199331,2cyclictest0-21swapper/007:30:140
72199331,2cyclictest0-21swapper/007:20:130
72199331,29cyclictest30733-21users08:10:310
72199331,28cyclictest28848-21tr08:45:190
72199331,28cyclictest28848-21tr08:45:190
72199331,28cyclictest23238-21kthreadcore12:10:210
72199331,28cyclictest19070-21latency_hist09:10:010
74199322,23cyclictest18332-21kworker/u8:012:30:272
72199321,28cyclictest3291-21cut11:40:230
72199321,28cyclictest3254-21kthreadcore07:10:210
72199321,27cyclictest2603-21kthreadcore11:05:200
72199321,26cyclictest0-21swapper/007:15:130
72199321,24cyclictest17799-21apt-get08:35:140
72199320,28cyclictest4844-21kthreadcore09:55:180
74999312,16cyclictest35966irq/58-eth007:45:133
74199318,20cyclictest261rcuc/210:15:152
74199311,16cyclictest22174-21ssh12:10:152
72199311,27cyclictest25956-21awk08:10:000
72199311,27cyclictest2426-21unixbench_multi08:15:280
72199310,27cyclictest16557-21munin-node08:00:110
72199310,27cyclictest16557-21munin-node08:00:100
72199310,27cyclictest12934-21/usr/sbin/munin09:00:260
74999301,16cyclictest35966irq/58-eth012:30:113
74199308,9cyclictest27-21ksoftirqd/210:33:382
74199308,15cyclictest18846-21diskmemload10:20:112
74199307,4cyclictest27-21ksoftirqd/209:15:012
74199302,21cyclictest0-21swapper/207:55:152
729993014,7cyclictest21-21ksoftirqd/108:00:121
729993014,7cyclictest21-21ksoftirqd/108:00:111
72199301,26cyclictest28464-21sendmail_mailtr07:35:280
72199301,26cyclictest17575-21pluginstate08:35:020
74199292,20cyclictest27346irq/40-dwc2_hso09:40:122
74199292,17cyclictest31320-21ssh10:10:132
74199292,17cyclictest31320-21ssh10:10:122
74999283,16cyclictest0-21swapper/312:28:273
74199286,15cyclictest27-21ksoftirqd/210:00:142
741992824,2cyclictest27346irq/40-dwc2_hso11:10:102
741992814,7cyclictest0-21swapper/207:45:152
741992811,14cyclictest22374-21cron08:40:012
74999272,15cyclictest35966irq/58-eth008:15:123
749992714,9cyclictest35966irq/58-eth009:25:133
74199275,17cyclictest708-21cyclictest08:30:132
74199272,18cyclictest708-21cyclictest11:40:142
729992714,10cyclictest0-21swapper/108:05:131
72999271,21cyclictest23651-21ssh11:35:141
74999263,16cyclictest0-21swapper/310:40:153
74999263,12cyclictest35966irq/58-eth008:45:123
74999263,12cyclictest35966irq/58-eth008:45:113
749992615,8cyclictest35966irq/58-eth012:10:143
74199268,11cyclictest7895-21ssh12:20:132
74199265,13cyclictest27346irq/40-dwc2_hso08:50:122
74199265,12cyclictest27-21ksoftirqd/207:20:202
74199264,14cyclictest0-21swapper/211:00:122
74199263,15cyclictest27346irq/40-dwc2_hso11:55:122
74199263,15cyclictest27346irq/40-dwc2_hso08:10:122
74199263,13cyclictest27346irq/40-dwc2_hso07:50:132
74199262,9cyclictest8001-21ssh12:36:052
74199262,20cyclictest0-21swapper/208:55:162
74199262,17cyclictest31252-21ssh12:15:122
74199262,14cyclictest18434-21ssh11:50:122
74199261,19cyclictest5184-21ssh09:20:122
741992611,6cyclictest13685-21sshd11:29:262
72999262,7cyclictest19852-21kworker/1:211:40:221
74999253,13cyclictest35966irq/58-eth011:25:123
74999252,14cyclictest0-21swapper/311:45:123
749992516,5cyclictest35966irq/58-eth012:05:143
74199259,10cyclictest131rcu_preempt10:08:262
74199251,17cyclictest15493-21ssh10:35:242
741992511,4cyclictest27-21ksoftirqd/209:34:562
72199251,21cyclictest708-21cyclictest07:10:020
749992412,9cyclictest0-21swapper/311:05:233
749992411,10cyclictest0-21swapper/309:30:233
74199248,7cyclictest0-21swapper/209:59:232
74199247,6cyclictest31684-21ssh10:26:182
74199246,7cyclictest27-21ksoftirqd/209:29:432
74199243,14cyclictest27346irq/40-dwc2_hso08:25:132
741992414,8cyclictest0-21swapper/208:45:232
741992414,8cyclictest0-21swapper/208:45:222
74999232,14cyclictest35966irq/58-eth012:15:133
74199238,9cyclictest131rcu_preempt11:31:272
74199237,7cyclictest27-21ksoftirqd/208:00:172
74199237,7cyclictest27-21ksoftirqd/208:00:172
74199236,9cyclictest15833-21tr07:25:172
74199236,11cyclictest27-21ksoftirqd/209:49:382
74199235,7cyclictest27-21ksoftirqd/211:37:272
74199235,7cyclictest27-21ksoftirqd/211:18:152
74199232,16cyclictest1600-21ssh11:05:152
74199231,9cyclictest940366ssh11:45:142
74199231,9cyclictest27-21ksoftirqd/210:42:032
741992314,7cyclictest0-21swapper/208:15:142
74199231,10cyclictest29184-21kthreadcore09:50:212
72999234,12cyclictest48-21kcompactd007:30:121
74999224,14cyclictest0-21swapper/311:15:133
749992212,7cyclictest35966irq/58-eth011:50:143
74199228,4cyclictest27-21ksoftirqd/209:17:092
74199221,5cyclictest3595-21grep08:20:152
741992213,7cyclictest6304-21cron10:50:012
741992212,8cyclictest0-21swapper/208:05:152
741992212,7cyclictest0-21swapper/212:01:182
72999222,15cyclictest18422-21ssh11:50:131
72999222,14cyclictest28442-21ssh09:15:151
72999221,17cyclictest16482-21ls08:00:021
72999221,16cyclictest4098-21ssh12:00:121
74999211,14cyclictest0-21swapper/310:55:133
74999211,14cyclictest0-21swapper/310:55:123
749992110,8cyclictest35966irq/58-eth009:10:133
749992110,8cyclictest0-21swapper/311:41:033
74199217,11cyclictest5715-21apt-get07:15:142
74199214,13cyclictest20242-21fschecks_count07:30:162
74199212,15cyclictest27396-21latency_hist08:45:022
74199212,10cyclictest2019-21latency_hist07:45:022
74199211,17cyclictest14982-21kthreadcore09:05:192
74199211,10cyclictest9580-21grep09:00:152
74199210,17cyclictest24975-21ls07:35:142
72999211,9cyclictest23595-21kthreadcore10:40:231
72999211,14cyclictest18275-21ssh09:45:161
729992110,8cyclictest24900-21apt-get07:35:131
72999210,16cyclictest10901-21idleruntime11:10:161
74999209,8cyclictest0-21swapper/310:15:273
74999207,8cyclictest35966irq/58-eth009:40:133
74999202,12cyclictest35966irq/58-eth010:30:143
74999201,14cyclictest0-21swapper/311:55:133
74999201,13cyclictest0-21swapper/308:35:163
74999201,13cyclictest0-21swapper/307:15:303
749992010,7cyclictest0-21swapper/309:35:183
74199204,12cyclictest5663-21grep07:15:022
72999203,3cyclictest131rcu_preempt07:40:131
72999202,9cyclictest8803-21ntp_kernel_pll_09:20:241
729992012,6cyclictest1945-21ssh12:15:211
72999201,15cyclictest17928-21ssh09:25:271
729992010,8cyclictest4627-21apt-get08:55:141
74999192,11cyclictest0-21swapper/307:10:143
749991913,3cyclictest0-21swapper/310:20:133
72999198,9cyclictest6979-21wc10:50:171
72999196,8cyclictest29463-21kworker/1:011:20:141
72999192,14cyclictest7901-21ssh12:20:131
729991911,5cyclictest17169-21ssh10:20:151
72999191,15cyclictest12232-21tr09:40:211
729991911,4cyclictest3821-21vmstat10:10:321
729991911,4cyclictest3821-21vmstat10:10:311
72999190,14cyclictest2213-21ls08:15:281
74999189,6cyclictest0-21swapper/309:20:273
74999187,6cyclictest0-21swapper/309:55:043
74999182,10cyclictest0-21swapper/308:10:143
74999181,13cyclictest0-21swapper/311:00:293
74999181,13cyclictest0-21swapper/308:30:153
74999181,13cyclictest0-21swapper/308:25:283
74999181,12cyclictest0-21swapper/308:00:283
74999181,12cyclictest0-21swapper/308:00:273
74999181,12cyclictest0-21swapper/307:40:153
72999188,7cyclictest21-21ksoftirqd/108:25:141
72999187,8cyclictest15105-21basename07:25:011
72999185,3cyclictest131rcu_preempt12:25:151
72999185,10cyclictest7485-21kthreadcore07:15:221
72999184,8cyclictest0-21swapper/108:20:121
72999183,9cyclictest0-21swapper/108:50:131
72999182,12cyclictest22165-21ssh12:10:151
72999182,12cyclictest18855-21apt-get09:10:021
72999181,9cyclictest31980-21latency_hist08:50:011
72999181,9cyclictest31980-21latency_hist08:50:001
72999181,5cyclictest1840-21usage_Anybus10:45:311
729991812,4cyclictest0-21swapper/111:30:271
74999179,6cyclictest0-21swapper/309:50:113
74999172,10cyclictest0-21swapper/312:20:133
74999172,10cyclictest0-21swapper/311:20:143
74999172,10cyclictest0-21swapper/307:55:153
74999171,13cyclictest35966irq/58-eth012:00:123
74999171,10cyclictest0-21swapper/307:35:143
749991710,5cyclictest0-21swapper/309:45:053
749991710,4cyclictest0-21swapper/311:10:203
74199171,8cyclictest839-21latency_hist07:10:012
72999178,6cyclictest13271-21fschecks_count12:05:181
72999176,6cyclictest21-21ksoftirqd/107:50:121
72999175,9cyclictest614-21dbus-daemon09:00:241
72999171,6cyclictest30076-21grep08:10:281
729991711,4cyclictest19944-21fschecks_time11:15:161
72999171,13cyclictest11839-21apt-get10:35:111
72999171,11cyclictest1-21systemd08:35:151
729991710,4cyclictest24721-21kthreadcore08:40:191
74999167,6cyclictest35966irq/58-eth009:15:153
74999163,10cyclictest321rcuc/308:40:123
74999162,10cyclictest0-21swapper/308:20:123
72999161,6cyclictest10531-21kthreadcore10:15:231
72999161,4cyclictest0-21swapper/107:10:351
72999161,12cyclictest15547-21grep07:25:171
72999161,12cyclictest0-21swapper/107:45:141
74999157,5cyclictest35966irq/58-eth008:55:143
72999151,11cyclictest13178-21fschecks_time08:30:151
74999142,10cyclictest0-21swapper/309:10:013
74999141,8cyclictest0-21swapper/307:50:123
74999141,8cyclictest0-21swapper/307:25:013
74999141,7cyclictest0-21swapper/309:00:163
74999138,3cyclictest0-21swapper/308:05:043
74999132,8cyclictest0-21swapper/307:25:123
74999131,7cyclictest0-21swapper/308:50:143
74999131,5cyclictest0-21swapper/307:35:003
72999131,10cyclictest605-21latency_hist07:10:021
74999111,5cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional