You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 19:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot7s.osadl.org (updated Thu Jul 09, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1042028462,18sleep10-21swapper/107:05:511
1071928370,9sleep00-21swapper/007:09:430
1024128263,17sleep30-21swapper/307:05:283
1064428168,9sleep20-21swapper/207:08:452
313282670,0sleep00-21swapper/010:43:520
1083899311,25cyclictest15670-21unixbench_multi12:10:261
1083899280,1cyclictest0-21swapper/111:26:281
1084099250,24cyclictest0-21swapper/212:01:172
1084099250,24cyclictest0-21swapper/212:01:172
1083899250,0cyclictest0-21swapper/110:19:001
1083899250,0cyclictest0-21swapper/110:11:331
10833992523,1cyclictest0-21swapper/010:39:120
1084099230,20cyclictest0-21swapper/208:55:122
1083899231,18cyclictest0-21swapper/108:10:121
1083899221,1cyclictest141rcu_preempt10:49:571
1083899220,1cyclictest0-21swapper/110:20:451
10843992011,5cyclictest0-21swapper/311:53:143
1083899200,1cyclictest0-21swapper/109:50:421
1083899200,0cyclictest0-21swapper/110:43:491
1083399205,8cyclictest4966-21munin-run12:05:000
1083399205,8cyclictest4966-21munin-run12:05:000
1084399190,2cyclictest0-21swapper/309:55:143
10840991916,1cyclictest0-21swapper/212:27:072
1084099190,1cyclictest0-21swapper/212:06:142
1083899192,11cyclictest21080-21apache210:56:441
1083899190,2cyclictest0-21swapper/111:00:231
1083899190,0cyclictest0-21swapper/109:10:121
1083399197,6cyclictest14368-21munin-run08:25:000
1083399190,1cyclictest141rcu_preempt10:54:480
10843991817,1cyclictest0-21swapper/310:04:143
10843991813,4cyclictest0-21swapper/312:31:523
1083899182,15cyclictest0-21swapper/112:24:051
10838991811,5cyclictest14366-21wc09:35:171
1083899180,1cyclictest0-21swapper/109:31:191
1083899180,17cyclictest0-21swapper/110:00:171
1084399172,5cyclictest141rcu_preempt12:05:343
1084099173,1cyclictest0-21swapper/210:56:252
10840991714,1cyclictest0-21swapper/210:42:312
1084099171,16cyclictest0-21swapper/212:31:462
1084099170,0cyclictest0-21swapper/209:59:232
10838991713,3cyclictest14926-21ls07:15:261
10838991713,2cyclictest0-21swapper/111:58:391
1083899170,1cyclictest0-21swapper/112:25:011
1083899170,1cyclictest0-21swapper/109:44:111
1083899170,17cyclictest0-21swapper/112:19:121
1083899170,16cyclictest0-21swapper/112:31:451
1083899170,0cyclictest0-21swapper/111:34:011
10843991615,1cyclictest0-21swapper/310:12:593
1084399161,15cyclictest0-21swapper/312:03:143
1084399161,15cyclictest0-21swapper/312:03:143
1084099160,1cyclictest0-21swapper/209:22:362
10833991615,1cyclictest0-21swapper/010:13:540
158232150,0chrt0-21swapper/310:54:093
10843991514,1cyclictest0-21swapper/311:47:273
1084099157,2cyclictest141rcu_preempt12:39:122
1084099151,14cyclictest3411-21diskmemload09:30:132
1084099150,15cyclictest0-21swapper/212:24:342
1083899156,7cyclictest5471-21cron09:50:001
10838991514,1cyclictest0-21swapper/110:33:551
1083899151,1cyclictest0-21swapper/110:28:191
1083399156,6cyclictest13-21ksoftirqd/009:50:240
10833991514,1cyclictest600-21kworker/u8:009:48:130
10833991512,2cyclictest13-21ksoftirqd/011:50:160
1083399151,1cyclictest141rcu_preempt09:34:170
1083399150,14cyclictest0-21swapper/012:26:340
1084399141,12cyclictest0-21swapper/307:25:133
10843991410,2cyclictest30181-21cut09:45:153
1084399140,1cyclictest0-21swapper/311:15:413
1084399140,12cyclictest6174-21cat09:30:193
1084099149,3cyclictest8195-21taskset11:46:482
1084099141,2cyclictest2354-21diskmemload09:47:342
10840991411,2cyclictest9794-21ssh11:10:002
10840991410,2cyclictest21407-21grep07:30:172
1084099140,1cyclictest24906-21ssh10:00:332
1084099140,1cyclictest0-21swapper/211:26:552
1083899143,8cyclictest5637-21wc11:45:201
1083899140,1cyclictest0-21swapper/110:05:491
10833991413,1cyclictest13-21ksoftirqd/010:20:000
10833991412,1cyclictest13-21ksoftirqd/009:55:290
10833991411,2cyclictest13-21ksoftirqd/011:35:390
10833991411,2cyclictest0-21swapper/009:41:450
1083399141,11cyclictest4821-21cron08:05:000
10833991410,3cyclictest28214-21grep08:50:270
1083399140,13cyclictest11715-21sh09:15:000
1083399140,12cyclictest0-21swapper/010:49:180
1083399140,10cyclictest0-21swapper/011:00:020
1084399139,3cyclictest29548-21sort08:55:153
1084399139,2cyclictest4902-21grep08:05:003
1084399139,2cyclictest39-21ksoftirqd/311:00:003
1084399138,3cyclictest3600-21wc09:10:013
1084399138,3cyclictest3600-21wc09:10:013
10843991310,2cyclictest30328-21cat09:25:193
10843991310,2cyclictest28708-21grep07:45:163
10843991310,2cyclictest28408-21taskset10:41:333
10843991310,2cyclictest22901-21cut12:15:173
10843991310,2cyclictest22562-21head08:40:153
10843991310,2cyclictest21566-21grep09:20:173
10843991310,2cyclictest21212-21ssh10:37:283
10843991310,2cyclictest17959-21munin-plugin-st07:25:003
10843991310,2cyclictest14923-21wc07:15:263
10843991310,2cyclictest1130-21grep10:25:193
1084399130,1cyclictest0-21swapper/311:05:333
10840991311,2cyclictest15766-21expr10:15:152
10840991311,1cyclictest26756-21uniq11:00:162
10840991310,2cyclictest718-21grep10:25:172
10840991310,2cyclictest18224-21head08:30:202
1084099130,9cyclictest21055-21apache210:47:212
1084099130,2cyclictest0-21swapper/209:10:262
1084099130,12cyclictest17982-21ls10:35:232
1084099130,11cyclictest0-21swapper/212:10:042
1083899139,3cyclictest3411-21diskmemload11:06:381
1083899138,3cyclictest20405-21ls08:35:201
1083899138,3cyclictest12534-21tr08:20:141
10838991311,2cyclictest0-21swapper/111:21:001
10838991310,2cyclictest30422-21sed11:40:261
10838991310,2cyclictest23693-21grep07:35:161
10838991310,2cyclictest1549-21grep07:55:211
1083899130,13cyclictest0-21swapper/112:04:011
1083899130,13cyclictest0-21swapper/112:04:011
1083399139,3cyclictest9580-21ls08:15:000
1083399139,3cyclictest19267-21grep10:55:260
1083399139,3cyclictest18995-21cut07:25:150
1083399139,3cyclictest15872-21grep07:20:140
10833991311,2cyclictest13-21ksoftirqd/009:15:150
1083399131,0cyclictest141rcu_preempt09:35:580
10833991310,2cyclictest32530-21wc10:05:210
10833991310,2cyclictest12714-21grep07:10:250
1083399130,12cyclictest32561-21sed09:00:220
1084399129,2cyclictest6143-21cat12:25:013
1084399129,2cyclictest27248-21sed07:40:273
1084399129,2cyclictest2673-21cron11:25:003
1084399129,2cyclictest25962-21grep10:20:283
1084399129,2cyclictest16135-21head10:15:183
1084399129,2cyclictest15341-21head08:25:183
1084399129,2cyclictest14467-21wc08:25:003
1084399129,1cyclictest1427-21rm10:06:013
1084399128,2cyclictest1076-21grep07:55:173
1084399127,5cyclictest21080-21apache209:18:373
1084399125,6cyclictest23169-21processes09:40:223
1084399124,7cyclictest0-21swapper/309:51:013
1084399122,7cyclictest0-21swapper/310:30:253
10843991210,2cyclictest39-21ksoftirqd/311:30:163
1084399120,6cyclictest0-21swapper/311:56:233
1084399120,11cyclictest26320-21sleep08:50:003
1084099129,2cyclictest9156-21grep08:10:262
1084099129,2cyclictest7866-21grep10:10:172
1084099129,2cyclictest630-21sed10:05:272
1084099129,2cyclictest28461-21cat11:20:182
1084099129,2cyclictest26812-21cat11:20:002
1084099129,2cyclictest23058-21sed12:15:182
1084099129,2cyclictest20123-21head08:35:172
1084099129,2cyclictest12957-21grep11:30:222
1084099127,1cyclictest30372-21apache_accesses07:50:112
1084099122,8cyclictest3411-21diskmemload09:10:012
1084099122,8cyclictest3411-21diskmemload09:10:002
10840991210,2cyclictest32-21ksoftirqd/211:12:532
1083899129,2cyclictest27986-21sort11:40:001
1083899129,2cyclictest26376-21wc08:50:001
1083899129,2cyclictest18988-21cut07:25:161
1083899129,2cyclictest17138-21tr08:30:141
1083899129,2cyclictest13312-21wc12:10:001
1083899128,3cyclictest21873-21sh10:37:591
1083899128,3cyclictest2008-21head09:05:171
1083899128,3cyclictest2008-21head09:05:171
1083899128,3cyclictest14731-21sed11:50:271
1083899127,2cyclictest14200-21ssh09:55:061
1083899120,2cyclictest0-21swapper/111:17:261
1083899120,2cyclictest0-21swapper/109:20:121
1083399129,2cyclictest4296-21wc11:25:200
1083399129,2cyclictest3423-21sleep09:10:000
1083399129,2cyclictest3423-21sleep09:10:000
1083399129,2cyclictest28672-21tr11:20:200
1083399129,2cyclictest23618-21cut07:35:160
1083399129,2cyclictest23536-21grep12:35:130
1083399129,2cyclictest23306-21wc08:40:250
1083399129,2cyclictest21019-21tr09:20:150
1083399129,2cyclictest15839-21grep12:30:170
1083399129,2cyclictest14729-21grep08:25:150
1083399128,3cyclictest30053-21head08:55:190
1083399128,3cyclictest22032-21ssh11:16:290
1083399128,3cyclictest11802-21ssh11:10:230
1083399128,1cyclictest1142-21runrttasks11:59:300
1083399127,2cyclictest13-21ksoftirqd/007:40:270
1083399124,5cyclictest3411-21diskmemload11:33:150
1083399123,8cyclictest9808-21latency_hist11:09:590
1083399121,6cyclictest3981-21munin-run11:45:000
1084399119,1cyclictest17020-21sshd12:11:243
1084399118,2cyclictest959-21rm11:42:403
1084399118,2cyclictest8067-21ssh12:25:223
1084399118,2cyclictest4773-21grep09:10:173
1084399118,2cyclictest4615-21head11:25:223
1084399118,2cyclictest31594-21grep09:00:153
1084399118,2cyclictest21214-21ssh10:56:483
1084399118,2cyclictest19981-21cut11:35:123
1084399118,2cyclictest19586-21ls08:35:143
1084399118,2cyclictest19106-21latency_hist08:35:003
1084399118,2cyclictest18434-21ssh09:37:533
1084399118,2cyclictest1748-21grep10:45:183
1084399118,2cyclictest13933-21ssh11:11:433
1084399118,2cyclictest13100-21chrt07:14:173
1084399118,2cyclictest10964-21cut08:15:203
1084399116,2cyclictest225-21systemd-journal08:06:043
1084399114,3cyclictest24726-21awk12:35:203
1084399112,5cyclictest26578-21apt-get08:50:143
1084099119,1cyclictest6519-21cat09:50:152
1084099119,1cyclictest21298-21grep11:35:192
1084099118,2cyclictest546-21sed09:00:272
1084099118,2cyclictest29027-21idleruntime-cro12:00:002
1084099118,2cyclictest26586-21cat07:40:192
1084099118,2cyclictest25015-21cat10:20:212
1084099118,2cyclictest23954-21uname07:35:192
1084099118,2cyclictest15181-21grep09:35:242
1084099118,2cyclictest13103-21grep11:50:162
1084099118,2cyclictest10677-21cat08:15:182
1084099116,2cyclictest225-21systemd-journal09:20:002
1083899118,2cyclictest32428-21ssh09:26:281
1083899118,2cyclictest29318-21cat08:55:131
1083899118,2cyclictest26205-21df07:40:161
1083899118,2cyclictest23457-21sh12:35:121
1083899118,2cyclictest17322-21wc07:20:261
1083899118,2cyclictest11758-21uname11:10:231
1083899117,3cyclictest12544-21cut09:15:141
1083899112,2cyclictest9173-21acpi10:50:121
1083399118,2cyclictest6405-21sh10:28:580
1083399118,2cyclictest6400-21tail11:45:270
1083399118,2cyclictest31277-21grep12:20:160
1083399118,2cyclictest30439-21ssh09:25:220
1083399118,2cyclictest25855-21grep08:45:260
1083399118,2cyclictest24455-21cut10:20:180
1083399118,2cyclictest22258-21sed07:30:270
1083399118,2cyclictest1639-21grep07:55:220
1083399118,2cyclictest14534-21tune2fs12:10:150
1083399118,2cyclictest11113-21chrt12:08:190
1083399117,2cyclictest6773-21tail08:05:260
1083399113,5cyclictest13-21ksoftirqd/008:30:210
1083399110,10cyclictest25857-21ssh10:01:180
1084399108,1cyclictest30680-21cat07:50:153
1084399107,2cyclictest22343-21grep07:30:273
1084399100,1cyclictest0-21swapper/308:10:123
1084099108,1cyclictest30638-21ssh11:40:312
1084099108,1cyclictest22852sleep207:58:132
1084099108,1cyclictest14006-21chrt08:20:372
1084099108,1cyclictest13396-21chrt07:15:012
1084099107,2cyclictest8666-21cat10:30:142
1084099107,2cyclictest5305-21cat08:05:152
1084099107,2cyclictest23562-21cat09:40:262
1084099107,2cyclictest23140-21find08:40:212
1084099107,2cyclictest16277-21expr07:20:152
1084099107,2cyclictest10052-21head10:50:172
1084099105,1cyclictest32-21ksoftirqd/209:25:472
1083899108,1cyclictest8292sleep109:02:391
1083899108,1cyclictest68462sleep108:05:291
1083899108,1cyclictest5006-21cat08:05:001
1083899108,1cyclictest321902sleep107:51:231
1083899108,1cyclictest300852sleep107:49:491
1083899108,1cyclictest22636-21chrt07:33:391
1083899108,1cyclictest15545-21uname08:25:201
1083899107,2cyclictest9984-21cut08:15:151
1083899107,2cyclictest23018-21sed08:40:201
1083899107,2cyclictest13084-21taskset07:14:051
1083399108,2cyclictest10687-21sh10:30:470
1083399108,1cyclictest243312sleep012:15:320
1083399108,1cyclictest212902sleep008:36:570
1083399108,1cyclictest13547-21grep07:15:140
1083399108,1cyclictest11251-21smart_sda08:15:250
1083399107,2cyclictest30640-21grep07:50:140
1083399107,2cyclictest29786-21taskset07:45:580
108439997,1cyclictest23374-21expr07:35:143
108409998,1cyclictest15803-21awk08:25:222
108409997,2cyclictest3497-21expr08:00:172
108409997,1cyclictest28108-21tr07:45:132
108409997,1cyclictest26540-21seq08:50:122
108409997,1cyclictest24167-21cat08:45:112
108409997,1cyclictest12884-21chrt07:11:292
108409992,3cyclictest225-21systemd-journal07:30:002
108389997,1cyclictest28062-21cat08:50:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional