You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 16:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Fri Aug 14, 2026 12:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1250021050,0sleep00-21swapper/010:03:200
2682528471,9sleep20-21swapper/207:06:362
2639028473,6sleep00-21swapper/007:05:290
2690828371,8sleep30-21swapper/307:07:423
2676228164,13sleep10-21swapper/107:05:461
214192620,0sleep20-21swapper/209:30:082
301012500,0sleep20-21swapper/209:54:492
2716899273,6cyclictest3650-21acpi11:15:102
2716899270,1cyclictest0-21swapper/212:22:042
2716399270,26cyclictest0-21swapper/109:44:181
2716899251,4cyclictest0-21swapper/209:25:202
27163992523,1cyclictest0-21swapper/109:55:141
2716399250,25cyclictest0-21swapper/110:22:391
2717399240,2cyclictest0-21swapper/311:10:473
2716899230,5cyclictest21227-21fschecks_count11:25:162
2716399230,23cyclictest0-21swapper/112:18:121
2716299231,2cyclictest0-21swapper/011:35:390
2716899220,3cyclictest0-21swapper/209:45:392
2716399222,10cyclictest21013-21/usr/sbin/munin09:10:161
269152220,0sleep00-21swapper/012:26:090
2717399210,20cyclictest0-21swapper/312:25:123
2716899217,1cyclictest0-21swapper/212:34:332
2716899212,7cyclictest20645-21grep11:05:192
2716899210,20cyclictest0-21swapper/210:52:282
2716899210,20cyclictest0-21swapper/210:40:152
2716899210,1cyclictest0-21swapper/210:00:312
2716899210,19cyclictest0-21swapper/211:32:352
2716899210,18cyclictest0-21swapper/211:42:382
2716899210,18cyclictest0-21swapper/210:56:322
2716899210,0cyclictest0-21swapper/210:47:252
2716899206,3cyclictest25199-1kworker/u9:012:10:372
2716899201,10cyclictest0-21swapper/212:00:122
2716399200,20cyclictest0-21swapper/112:25:121
2717399190,1cyclictest0-21swapper/311:43:073
2716899191,11cyclictest0-21swapper/208:20:132
2716399194,12cyclictest19969-21diskmemload12:01:541
2716399190,1cyclictest19969-21diskmemload11:20:231
2716399190,18cyclictest0-21swapper/110:59:311
2716899184,3cyclictest225-21systemd-journal09:08:592
2716899182,5cyclictest0-21swapper/212:35:242
2716899180,17cyclictest0-21swapper/210:20:152
2716899180,16cyclictest0-21swapper/211:03:402
27163991816,1cyclictest38150irq/131-snd_hda07:20:191
2716399181,13cyclictest0-21swapper/107:55:131
2717399173,10cyclictest12205-21ssh12:17:463
2717399172,14cyclictest17634-21apache210:28:363
2717399170,2cyclictest0-21swapper/309:30:313
2717399170,1cyclictest0-21swapper/312:03:293
2717399170,0cyclictest0-21swapper/310:22:533
2716899172,3cyclictest13067-21aten2_r7power_c08:55:182
2716899170,15cyclictest0-21swapper/210:07:522
2716399172,2cyclictest141rcu_preempt11:48:481
2716399170,1cyclictest0-21swapper/112:38:211
2716299175,2cyclictest141rcu_preempt09:10:370
2717399160,3cyclictest0-21swapper/309:35:143
2716899169,6cyclictest30557-21tr11:50:142
2716899169,6cyclictest28945-21sort11:10:192
2716899168,7cyclictest7344-21basename10:20:002
2716899168,2cyclictest26740-21ssh12:26:022
2716899162,5cyclictest225-21systemd-journal10:00:002
2716899162,3cyclictest0-21swapper/207:20:002
27168991610,5cyclictest8514-21cat07:35:262
2716899160,7cyclictest5795-21apache_volume09:40:122
2716899160,2cyclictest0-21swapper/210:25:122
2716899160,0cyclictest0-21swapper/210:13:252
2716399160,1cyclictest0-21swapper/112:11:401
2716399160,1cyclictest0-21swapper/111:28:041
2716399160,14cyclictest19969-21diskmemload11:53:571
2716399160,0cyclictest0-21swapper/112:33:211
2716299161,8cyclictest24100-21apt-get10:29:590
27173991513,1cyclictest15480-21kworker/3:212:10:123
2717399150,2cyclictest0-21swapper/310:18:163
2717399150,0cyclictest0-21swapper/309:19:153
2716899159,5cyclictest5624-21sh08:39:592
2716899158,2cyclictest31256-21ssh09:15:452
2716899158,1cyclictest32672-21ls08:25:252
2716899158,1cyclictest23012-21rm12:05:132
2716899156,2cyclictest12091-21chrt11:20:122
2716899151,4cyclictest225-21systemd-journal10:35:002
27163991514,1cyclictest0-21swapper/109:49:441
2716399150,15cyclictest0-21swapper/110:50:231
2716399150,15cyclictest0-21swapper/110:10:321
2716399150,0cyclictest0-21swapper/109:26:281
27162991515,0cyclictest0-21swapper/009:46:030
2716299151,1cyclictest0-21swapper/011:18:470
27173991413,1cyclictest15480-21kworker/3:211:56:223
2717399140,1cyclictest0-21swapper/312:30:133
2716899148,5cyclictest5619-21tail09:20:172
2716899147,6cyclictest28116-21head07:10:162
2716899147,2cyclictest9786-21ssh12:15:502
2716899147,2cyclictest29802-21cut11:50:002
2716899147,2cyclictest20795-21expr09:10:152
2716899147,2cyclictest10670-21cut08:50:132
2716899147,2cyclictest10318-21cat07:40:162
2716899147,1cyclictest6328-21sh10:38:122
2716899143,2cyclictest225-21systemd-journal07:29:552
27168991410,3cyclictest16019-21cut09:00:162
2716899140,5cyclictest225-21systemd-journal08:50:002
2716899140,4cyclictest225-21systemd-journal08:08:322
2716399149,5cyclictest38150irq/131-snd_hda09:37:111
27163991412,1cyclictest0-21swapper/109:50:141
2716399140,0cyclictest0-21swapper/110:36:021
2716299148,2cyclictest225-21systemd-journal08:53:550
27162991410,3cyclictest7298-21cron10:19:590
27162991410,2cyclictest32032-21ssh11:50:250
2716299140,7cyclictest29773-21perf11:50:000
55702130,0sleep35573-21grep11:35:163
2717399139,3cyclictest23503-21cat12:25:003
2717399139,3cyclictest10245-21grep07:40:153
2717399139,2cyclictest5639-21sleep08:39:593
2717399132,7cyclictest12094-21ssh11:20:133
2717399131,7cyclictest0-21swapper/309:29:433
2717399131,1cyclictest0-21swapper/310:50:473
2717399131,11cyclictest30373-21ls09:55:013
27173991311,1cyclictest0-21swapper/309:10:143
27173991310,2cyclictest27461-21wc08:15:233
27173991310,2cyclictest19658-21grep10:45:263
2717399130,13cyclictest0-21swapper/312:06:363
2717399130,12cyclictest5638-21tail11:15:253
2717399130,0cyclictest0-21swapper/311:30:133
2716899138,1cyclictest142362sleep207:50:112
2716899137,2cyclictest29701-21ssh09:35:072
2716899137,1cyclictest6419-21tr11:55:132
2716899134,8cyclictest0-21swapper/207:45:142
2716899130,9cyclictest7170-21ssh11:35:412
27163991313,0cyclictest0-21swapper/111:13:451
27163991313,0cyclictest0-21swapper/109:33:351
27163991312,1cyclictest0-21swapper/111:04:191
27163991310,2cyclictest421-21grep08:25:251
27163991310,2cyclictest27630-21tr07:10:151
27163991310,2cyclictest17564-21cut10:25:201
2716399130,10cyclictest0-21swapper/111:19:261
2716299139,3cyclictest9575-21wc12:35:200
2716299139,3cyclictest29693-21tail11:10:260
2716299139,3cyclictest23108-21tail08:05:290
2716299132,6cyclictest25948-21idleruntime-cro08:15:000
2716299131,7cyclictest7194-21tr09:40:220
2716299131,6cyclictest0-21swapper/011:00:150
27162991312,1cyclictest0-21swapper/009:59:270
27162991310,2cyclictest9800-21grep10:20:280
27162991310,2cyclictest4475-21ssh11:35:000
27162991310,2cyclictest29368-21cron09:35:000
27162991310,2cyclictest18081-21grep10:45:140
27162991310,2cyclictest16483-21sed12:20:180
2716299130,7cyclictest0-21swapper/012:05:420
304552120,1sleep10-21swapper/109:15:251
2717399129,2cyclictest8644-21ssh12:35:143
2717399129,2cyclictest8349-21grep08:45:133
2717399129,2cyclictest26678-21sed10:30:263
2717399129,2cyclictest18677-21idleruntime-cro11:04:593
2717399129,2cyclictest16020-21sort09:00:163
2717399129,2cyclictest11983-21taskset07:45:153
2717399128,3cyclictest22695-21head11:45:163
2717399128,3cyclictest21161-21sh11:25:153
2717399127,3cyclictest3770-21ssh10:55:233
27173991210,1cyclictest239752sleep311:07:263
2717399120,12cyclictest0-21swapper/311:54:513
2716899129,2cyclictest3251-21munin-plugin-st08:35:002
2716899127,1cyclictest25605-21taskset08:11:012
2716899127,1cyclictest20956-21chrt08:02:222
2716399129,2cyclictest7814-21head07:35:181
2716399129,2cyclictest5648-21awk08:39:591
2716399129,2cyclictest2634-21tr07:25:171
2716399129,2cyclictest2373-21tr08:30:231
2716399129,2cyclictest21172-21cron08:05:011
2716399128,4cyclictest38150irq/131-snd_hda08:15:171
2716399127,3cyclictest10724-21grep07:40:201
2716399122,4cyclictest13253-21grep08:55:191
2716399122,3cyclictest225-21systemd-journal09:25:011
2716399121,3cyclictest225-21systemd-journal08:10:321
27163991210,1cyclictest0-21swapper/110:07:141
2716399120,12cyclictest0-21swapper/110:33:121
2716399120,0cyclictest0-21swapper/111:41:531
2716299129,2cyclictest8525-21grep12:15:210
2716299129,2cyclictest7599-21head08:40:260
2716299129,2cyclictest32690-21awk10:35:000
2716299129,2cyclictest31883-21cut08:25:150
2716299129,2cyclictest31498-21cut12:10:150
2716299129,2cyclictest27859-21grep08:15:280
2716299129,2cyclictest23342-21grep09:50:170
2716299129,2cyclictest23009-21cron10:10:010
2716299129,2cyclictest14678-21grep08:55:300
2716299129,2cyclictest13898-21sort09:25:190
2716299129,2cyclictest10132-21chrt11:56:570
2716299128,3cyclictest9213-21run-parts07:40:010
2716299128,3cyclictest30777-21wc07:15:190
2716299128,3cyclictest14040-21cat07:50:000
2716299127,4cyclictest15905-21ntpq12:00:210
2716299124,4cyclictest225-21systemd-journal11:25:330
2716299120,11cyclictest1904-21sed08:30:180
2717399118,2cyclictest9837-21tune2fs10:40:173
2717399118,2cyclictest8725-21seq07:35:273
2717399118,2cyclictest7069-21cut10:00:143
2717399118,2cyclictest6651-21tr08:40:183
2717399118,2cyclictest6598-21tail09:40:163
2717399118,2cyclictest5868-21ntpq07:30:253
2717399118,2cyclictest5866-21cut09:20:193
2717399118,2cyclictest3369-21ssh10:35:543
2717399118,2cyclictest3356-21cat08:35:003
2717399118,2cyclictest28342-21uname07:10:183
2717399118,2cyclictest24522-21grep08:10:163
2717399118,2cyclictest23481-21ssh10:10:113
2717399118,2cyclictest22263-21basename08:05:193
2717399118,2cyclictest20770-21sed08:00:273
2717399118,2cyclictest18496-21taskset07:56:303
2717399118,2cyclictest16526-21sh09:45:453
2717399118,2cyclictest15131-21ssh10:05:113
2717399118,2cyclictest13708-21sort08:55:213
2717399118,2cyclictest1095-21ssh09:55:573
2716899118,2cyclictest26951-21cut08:15:192
2716399119,1cyclictest21331-21sed11:05:251
2716399118,2cyclictest8037-21sed11:55:251
2716399118,2cyclictest6685-21ssh10:00:081
2716399118,2cyclictest32095-21egrep10:15:141
2716399118,2cyclictest29331-21expr11:30:141
2716399118,2cyclictest22062-21cut08:05:181
2716399118,2cyclictest16165-21grep12:20:161
2716399118,2cyclictest11982-21cut07:45:141
2716399116,2cyclictest8950-21ssh10:40:041
2716399116,1cyclictest4868-21cut07:30:161
2716399115,5cyclictest38150irq/131-snd_hda10:45:261
2716299118,2cyclictest9620-21basename07:40:120
2716299118,2cyclictest9339-21rm10:40:140
2716299118,2cyclictest5788-21ssh12:33:200
2716299118,2cyclictest471-21rm09:36:160
2716299118,2cyclictest312-21ssh10:54:000
2716299118,2cyclictest30176-21ssh09:15:200
2716299118,2cyclictest2620-21sed10:35:260
2716299118,2cyclictest23494-21ssh11:07:030
2716299118,2cyclictest23403-21ssh10:10:070
2716299118,2cyclictest20959-21chrt08:02:240
2716299118,2cyclictest1796-21chrt07:21:250
2716299118,2cyclictest17111-21grep09:00:280
2716299118,2cyclictest16133-21ssh11:22:010
2716299118,2cyclictest15224-21wc07:50:180
2716299117,3cyclictest2090-21ssh10:55:010
2716299117,2cyclictest4802-21basename09:20:130
2716299117,2cyclictest2419-21basename07:25:170
2716299111,6cyclictest4980-21cpuspeed_turbos07:30:170
2716299111,4cyclictest19969-21diskmemload11:41:030
2717399108,1cyclictest3404-21cat07:25:233
2717399108,1cyclictest32625-21sed08:25:253
2717399108,1cyclictest30107-21cat07:15:153
2717399108,1cyclictest29588-21grep08:20:193
2717399108,1cyclictest18727-21cat09:05:173
2717399108,1cyclictest14445-21cat07:50:133
2717399107,2cyclictest10900-21cut08:50:143
2717399100,9cyclictest32361-21chrt07:20:073
2716899108,1cyclictest7934-21chrt08:44:092
2716899108,1cyclictest302-21expr07:20:152
2716899108,1cyclictest18028-21sendmail_mailtr07:55:232
2716899107,2cyclictest4827-21hostname07:30:172
2716399108,1cyclictest5352-21expr11:35:141
2716399108,1cyclictest16524-21strings09:00:201
2716399108,1cyclictest161912sleep107:53:111
2716399108,1cyclictest10258-21chrt08:48:321
2716399107,2cyclictest6826-21uname08:40:201
2716399107,2cyclictest29386-21tail08:20:171
2716399107,2cyclictest23164-21cut12:05:161
2716399107,2cyclictest17814-21chrt09:05:021
2716399107,2cyclictest11977-21sendmail_mailst08:50:221
2716299108,1cyclictest273642sleep007:10:030
2716299108,1cyclictest17850-21awk07:55:220
2716299107,2cyclictest4827-21grep08:35:230
2716299107,2cyclictest18345-21sed09:05:130
2716299100,9cyclictest300002sleep008:20:270
2716299100,9cyclictest0-21swapper/008:45:270
271639997,1cyclictest315742sleep107:16:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional