You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 11:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sat Jul 18, 2026 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1834699260,25cyclictest20655-21sh00:09:363
18343992623,2cyclictest29410-21latency_hist21:25:002
1834099260,25cyclictest21917-21ssh22:44:021
18346992524,1cyclictest12437-21diskmemload23:05:483
1834699250,24cyclictest5827-21perf22:30:013
18343992523,1cyclictest29831-21ssh23:48:562
18343992523,1cyclictest29831-21ssh23:48:562
1834399250,24cyclictest28599-21ssh00:17:282
1834399250,24cyclictest0-21swapper/223:56:102
1834399250,24cyclictest0-21swapper/223:54:472
1834399250,1cyclictest12437-21diskmemload00:27:252
1834099250,2cyclictest2032-21ssh22:55:321
1833699253,21cyclictest62550irq/127-eno123:22:290
18336992523,1cyclictest25089-21diskmemload21:21:310
1833699250,24cyclictest12437-21diskmemload23:13:000
1833699250,24cyclictest0-21swapper/023:49:280
1833699250,24cyclictest0-21swapper/023:49:280
18346992421,2cyclictest8914-21ssh23:02:183
1834699240,23cyclictest12437-21diskmemload23:51:353
1834699240,23cyclictest0-21swapper/323:35:373
1834699240,23cyclictest0-21swapper/323:16:503
1834699240,23cyclictest0-21swapper/321:30:053
1834699240,1cyclictest10126-21sh00:00:343
1834699240,1cyclictest0-21swapper/323:47:313
1834699240,1cyclictest0-21swapper/323:47:313
18343992422,1cyclictest0-21swapper/223:07:122
18343992420,2cyclictest13113-21rm21:10:322
1834399240,23cyclictest0-21swapper/222:41:352
1834399240,23cyclictest0-21swapper/222:00:522
1834399240,23cyclictest0-21swapper/200:37:272
1834099242,21cyclictest12437-21diskmemload22:32:531
1834099240,24cyclictest0-21swapper/100:07:561
1834099240,23cyclictest30868-21apt-get20:42:261
1834099240,23cyclictest30868-21apt-get20:42:261
1834099240,23cyclictest30019-21diskmemload21:25:301
1834099240,23cyclictest12437-21diskmemload00:11:091
1834099240,23cyclictest11120-21sh22:06:511
1834099240,23cyclictest0-21swapper/122:36:211
1834099240,0cyclictest0-21swapper/121:31:581
18336992424,0cyclictest0-21swapper/021:34:460
18336992422,1cyclictest7052-21sh23:28:200
1833699242,1cyclictest62550irq/127-eno123:55:470
1833699240,24cyclictest0-21swapper/000:09:230
1833699240,23cyclictest30313-21ssh22:52:260
1833699240,23cyclictest25520-21ls19:25:000
1833699240,23cyclictest12437-21diskmemload23:43:300
1833699240,23cyclictest0-21swapper/023:03:050
18346992323,0cyclictest24314-21kworker/u8:021:51:423
18346992323,0cyclictest12437-21diskmemload00:30:453
18346992323,0cyclictest12437-21diskmemload00:30:453
18346992323,0cyclictest0-21swapper/323:21:373
18346992323,0cyclictest0-21swapper/322:36:323
18346992323,0cyclictest0-21swapper/322:16:333
18346992322,1cyclictest12437-21diskmemload22:52:173
18346992321,1cyclictest18451-21apt-get20:17:273
18346992321,1cyclictest12437-21diskmemload21:22:353
18346992320,2cyclictest30561-21sh21:26:193
18346992320,2cyclictest17085-21ssh00:35:303
1834699231,21cyclictest0-21swapper/322:30:043
1834699230,2cyclictest29986-21cron20:40:023
1834699230,2cyclictest29986-21cron20:40:023
1834699230,2cyclictest15456-21sh22:10:083
1834699230,23cyclictest0-21swapper/322:43:533
1834699230,22cyclictest4688-21sh22:00:503
1834699230,22cyclictest0-21swapper/323:31:353
1834699230,0cyclictest0-21swapper/321:13:553
1834699230,0cyclictest0-21swapper/300:13:123
18343992323,0cyclictest0-21swapper/221:47:462
18343992323,0cyclictest0-21swapper/221:44:122
18343992323,0cyclictest0-21swapper/219:57:272
18343992322,1cyclictest0-21swapper/223:10:112
1834399230,2cyclictest16957-21rm00:06:482
1834399230,2cyclictest12712-21sh22:36:262
1834399230,23cyclictest0-21swapper/200:02:092
1834399230,22cyclictest27596-21awk20:35:002
1834399230,22cyclictest27223-21ssh22:20:272
1834399230,22cyclictest25834-21ssh23:17:142
1834399230,22cyclictest24043-21sh00:12:322
1834399230,22cyclictest22431-21rm23:42:302
1834399230,22cyclictest12437-21diskmemload22:59:332
1834399230,22cyclictest0-21swapper/222:51:522
1834399230,22cyclictest0-21swapper/222:10:342
1834399230,1cyclictest0-21swapper/200:23:292
1834399230,0cyclictest0-21swapper/223:36:592
1834399230,0cyclictest0-21swapper/222:46:202
1834399230,0cyclictest0-21swapper/222:34:552
1834399230,0cyclictest0-21swapper/221:55:472
1834399230,0cyclictest0-21swapper/221:33:462
18340992323,0cyclictest0-21swapper/123:54:251
18340992323,0cyclictest0-21swapper/123:01:371
18340992323,0cyclictest0-21swapper/122:21:351
18340992323,0cyclictest0-21swapper/121:42:101
18340992323,0cyclictest0-21swapper/121:11:121
18340992322,1cyclictest0-21swapper/100:20:411
18340992321,1cyclictest12437-21diskmemload22:00:231
18340992321,1cyclictest0-21swapper/123:20:451
18340992321,1cyclictest0-21swapper/100:31:241
18340992321,1cyclictest0-21swapper/100:31:241
18340992320,2cyclictest5494-21sh19:50:001
18340992320,2cyclictest27428-21df23:47:261
18340992320,2cyclictest27428-21df23:47:261
18340992320,2cyclictest20030-21sh21:45:421
1834099230,2cyclictest25525-21idleruntime-cro19:25:001
1834099230,2cyclictest19658-21sh23:11:471
1834099230,2cyclictest12936-21ssh21:38:581
1834099230,23cyclictest0-21swapper/121:20:271
1834099230,22cyclictest6526-21ssh23:27:401
1834099230,22cyclictest22441-21ssh22:16:311
1834099230,22cyclictest14579-21rm00:04:201
1834099230,22cyclictest0-21swapper/123:17:201
1834099230,22cyclictest0-21swapper/121:57:101
1834099230,0cyclictest0-21swapper/123:36:231
1834099230,0cyclictest0-21swapper/121:18:471
18336992323,0cyclictest0-21swapper/023:51:510
18336992323,0cyclictest0-21swapper/023:36:230
18336992323,0cyclictest0-21swapper/023:16:510
18336992322,1cyclictest62550irq/127-eno100:19:140
18336992321,1cyclictest32244-21apt22:25:010
18336992321,1cyclictest13-21ksoftirqd/022:15:000
18336992321,1cyclictest0-21swapper/000:30:060
18336992321,1cyclictest0-21swapper/000:30:060
1833699231,21cyclictest0-21swapper/021:51:260
1833699230,23cyclictest0-21swapper/021:45:290
1833699230,23cyclictest0-21swapper/021:17:320
1833699230,22cyclictest6242-21sh22:30:160
1833699230,22cyclictest16399-21ssh23:07:400
1833699230,22cyclictest0-21swapper/000:20:040
1833699230,21cyclictest0-21swapper/021:10:080
1833699230,1cyclictest62550irq/127-eno122:08:050
1833699230,0cyclictest12437-21diskmemload00:25:360
1833699230,0cyclictest0-21swapper/022:41:590
18346992222,0cyclictest12437-21diskmemload23:55:363
18346992222,0cyclictest0-21swapper/323:40:403
18346992222,0cyclictest0-21swapper/320:22:263
18346992222,0cyclictest0-21swapper/300:26:443
18346992222,0cyclictest0-21swapper/300:16:193
18346992221,1cyclictest13021-21ssh21:39:053
18346992220,1cyclictest19875-21ssh21:45:303
18346992220,1cyclictest0-21swapper/321:41:253
1834699220,21cyclictest7567-21cron21:00:013
1834699220,21cyclictest508-21ssh00:20:483
1834699220,21cyclictest0-21swapper/323:10:163
1834699220,21cyclictest0-21swapper/319:17:283
1834699220,1cyclictest3001-21ssh23:25:063
1834699220,1cyclictest10015-21ssh22:05:173
1834699220,0cyclictest0-21swapper/322:46:033
18343992222,0cyclictest0-21swapper/221:36:312
18343992221,1cyclictest12437-21diskmemload23:04:362
18343992221,1cyclictest10504-21apt-get21:07:272
18343992221,0cyclictest0-21swapper/223:30:002
18343992220,1cyclictest30004-21apt-get20:40:012
18343992220,1cyclictest2399-21rm21:29:502
18343992220,1cyclictest13600-21apt-get20:07:252
18343992220,1cyclictest11213-21sh00:30:012
18343992220,1cyclictest11213-21sh00:30:012
1834399220,21cyclictest7617-21perf21:00:012
1834399220,21cyclictest23569-21apt-get19:22:252
1834399220,21cyclictest10401-21ssh22:05:562
1834399220,21cyclictest0-21swapper/223:30:052
1834399220,21cyclictest0-21swapper/223:20:102
1834399220,1cyclictest32244-21apt-get22:25:022
1834399220,1cyclictest0-21swapper/222:15:022
1834399220,1cyclictest0-21swapper/221:17:502
1834399220,0cyclictest25459-21ssh21:50:022
18340992222,0cyclictest0-21swapper/123:07:541
18340992222,0cyclictest0-21swapper/121:50:131
18340992222,0cyclictest0-21swapper/100:36:021
18340992222,0cyclictest0-21swapper/100:15:571
18340992221,1cyclictest0-21swapper/123:41:341
18340992221,1cyclictest0-21swapper/122:10:401
18340992220,1cyclictest0-21swapper/123:30:351
1834099221,0cyclictest28360-21apt-get19:32:261
1834099220,22cyclictest0-21swapper/122:45:181
1834099220,21cyclictest5644-21apt-get20:57:271
1834099220,21cyclictest10751-21awk20:00:011
1834099220,21cyclictest0-21swapper/123:57:471
1834099220,21cyclictest0-21swapper/122:25:021
1834099220,21cyclictest0-21swapper/120:12:251
1834099220,1cyclictest660-21idleruntime-cro19:40:001
1834099220,1cyclictest21157-21apt-get19:17:281
1834099220,1cyclictest0-21swapper/122:50:011
18336992222,0cyclictest0-21swapper/023:32:530
18336992222,0cyclictest0-21swapper/022:45:420
18336992222,0cyclictest0-21swapper/020:22:260
18336992221,1cyclictest0-21swapper/022:01:330
18336992220,2cyclictest0-21swapper/000:00:360
18336992220,1cyclictest10755-21perf20:00:010
18336992220,1cyclictest0-21swapper/022:55:500
18336992220,1cyclictest0-21swapper/000:10:250
1833699220,21cyclictest0-21swapper/022:15:020
1833699220,21cyclictest0-21swapper/021:55:230
1833699220,21cyclictest0-21swapper/021:36:100
1833699220,21cyclictest0-21swapper/020:07:250
1833699220,21cyclictest0-21swapper/019:37:250
1833699220,1cyclictest0-21swapper/022:29:260
1833699220,1cyclictest0-21swapper/021:41:060
1833699220,1cyclictest0-21swapper/021:02:270
1833699220,1cyclictest0-21swapper/000:36:530
18346992121,0cyclictest0-21swapper/322:56:223
18346992120,0cyclictest0-21swapper/320:47:273
1834699210,21cyclictest0-21swapper/322:20:233
1834699210,20cyclictest0-21swapper/320:37:273
1834699210,0cyclictest0-21swapper/319:27:243
18343992120,1cyclictest20868-21apt-get20:22:262
18343992120,1cyclictest10078-21basename21:05:002
18343992119,1cyclictest2793-21dump-pmu-power20:50:012
1834399210,1cyclictest3553-21apt-get19:47:262
18340992121,0cyclictest0-21swapper/120:27:271
18340992121,0cyclictest0-21swapper/100:25:271
18340992120,0cyclictest0-21swapper/119:42:251
1834099210,1cyclictest27625-21perf20:35:001
1834099210,1cyclictest22809-21latency_hist20:25:001
18336992121,0cyclictest15995-21apt-get20:12:250
18336992120,0cyclictest0-21swapper/020:57:270
1833699210,21cyclictest0-21swapper/019:17:280
1833699210,20cyclictest0-21swapper/019:52:260
1833699210,20cyclictest0-21swapper/019:52:260
1833699210,0cyclictest25656-21apt-get20:32:240
18346992020,0cyclictest1148-21apt-get19:42:253
18346992020,0cyclictest0-21swapper/319:37:253
18346992020,0cyclictest0-21swapper/319:32:263
18346992020,0cyclictest0-21swapper/319:12:253
18346992019,0cyclictest0-21swapper/320:02:243
1834699200,20cyclictest0-21swapper/321:02:273
1834699200,0cyclictest0-21swapper/321:07:273
18343992020,0cyclictest0-21swapper/219:42:252
18343992020,0cyclictest0-21swapper/219:27:242
1834399200,19cyclictest11205-21apt-get20:02:252
18340992019,0cyclictest3249-21apt-get20:52:281
18336992020,0cyclictest0-21swapper/020:42:260
18336992020,0cyclictest0-21swapper/020:42:260
18336992018,1cyclictest5481-21cron19:50:000
1833699200,20cyclictest0-21swapper/020:52:270
1833699200,0cyclictest0-21swapper/020:27:270
18346991919,0cyclictest0-21swapper/319:55:023
18346991919,0cyclictest0-21swapper/319:52:263
18346991919,0cyclictest0-21swapper/319:52:263
18346991919,0cyclictest0-21swapper/319:50:003
18346991918,1cyclictest23262-21apt-get20:27:273
18343991919,0cyclictest0-21swapper/220:27:272
18343991919,0cyclictest0-21swapper/220:12:252
18343991919,0cyclictest0-21swapper/219:52:262
18343991919,0cyclictest0-21swapper/219:52:262
18343991917,1cyclictest30936-21apt-get19:35:022
18343991916,2cyclictest23131-21perf19:20:012
18340991919,0cyclictest28055-21apt-get20:37:271
18340991918,1cyclictest0-21swapper/121:07:271
18336991919,0cyclictest0-21swapper/020:37:260
18336991919,0cyclictest0-21swapper/019:27:250
18346991817,0cyclictest0-21swapper/320:32:243
18343991817,0cyclictest0-21swapper/219:32:262
18343991816,1cyclictest606-21dbus-daemon20:45:012
18343991816,1cyclictest606-21dbus-daemon20:45:012
18340991818,0cyclictest0-21swapper/119:12:251
18336991818,0cyclictest0-21swapper/019:42:250
1834399177,9cyclictest31953-21munin-node19:14:582
18343991717,0cyclictest0-21swapper/220:17:272
18340991717,0cyclictest0-21swapper/121:02:271
18340991714,2cyclictest13161-21latency_hist20:05:011
18336991717,0cyclictest0-21swapper/021:07:270
18336991716,1cyclictest0-21swapper/019:12:250
18340991614,1cyclictest0-21swapper/120:17:291
1834099160,1cyclictest26339-21cstates19:27:251
1834099160,15cyclictest0-21swapper/119:52:311
1834099160,15cyclictest0-21swapper/119:52:311
1833699160,15cyclictest30729-21apt-config19:35:010
18346991515,0cyclictest0-21swapper/320:52:273
1834699150,1cyclictest0-21swapper/320:10:013
1834699150,14cyclictest0-21swapper/319:22:333
1834399150,1cyclictest0-21swapper/220:55:012
18336991512,2cyclictest11724-21fschecks_time20:02:260
1834699140,0cyclictest0-21swapper/320:13:473
18340991412,1cyclictest0-21swapper/120:47:271
1833699140,14cyclictest0-21swapper/020:16:350
1833699140,0cyclictest0-21swapper/020:45:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional