You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 19:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Jan 02, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26038991918,1cyclictest65850irq/126-lan11:45:190
26038991918,1cyclictest65850irq/126-lan11:10:130
26038991818,0cyclictest65850irq/126-lan08:47:130
26038991817,1cyclictest65850irq/126-lan12:25:210
26038991817,1cyclictest65850irq/126-lan11:40:170
26038991817,1cyclictest65850irq/126-lan07:58:550
26038991717,0cyclictest65850irq/126-lan10:57:390
26038991717,0cyclictest65850irq/126-lan10:30:010
26038991717,0cyclictest65850irq/126-lan08:35:180
26038991716,1cyclictest65850irq/126-lan11:22:390
26038991716,1cyclictest65850irq/126-lan10:00:130
26038991716,1cyclictest65850irq/126-lan09:55:210
26038991716,1cyclictest65850irq/126-lan09:25:230
26038991716,1cyclictest65850irq/126-lan07:50:260
26038991716,1cyclictest65850irq/126-lan07:35:210
26038991616,0cyclictest65850irq/126-lan12:06:390
26038991616,0cyclictest65850irq/126-lan10:10:130
26038991616,0cyclictest65850irq/126-lan09:50:090
26038991616,0cyclictest65850irq/126-lan08:30:100
26038991615,1cyclictest65850irq/126-lan12:00:140
26038991615,1cyclictest65850irq/126-lan11:55:150
26038991615,1cyclictest65850irq/126-lan11:25:210
26038991615,1cyclictest65850irq/126-lan10:43:160
26038991615,1cyclictest65850irq/126-lan10:20:160
26038991615,1cyclictest65850irq/126-lan10:20:160
26038991615,1cyclictest65850irq/126-lan09:35:120
26038991615,1cyclictest65850irq/126-lan09:05:110
26038991615,1cyclictest65850irq/126-lan07:20:190
26038991515,0cyclictest65850irq/126-lan12:36:390
26038991515,0cyclictest65850irq/126-lan12:20:120
26038991515,0cyclictest65850irq/126-lan10:35:140
26038991515,0cyclictest65850irq/126-lan09:14:390
26038991515,0cyclictest65850irq/126-lan08:20:160
26038991515,0cyclictest65850irq/126-lan08:05:150
26038991515,0cyclictest65850irq/126-lan07:29:380
26038991514,1cyclictest65850irq/126-lan12:30:170
26038991514,1cyclictest65850irq/126-lan11:50:190
26038991514,1cyclictest65850irq/126-lan11:00:210
26038991514,1cyclictest65850irq/126-lan09:00:150
26038991514,1cyclictest65850irq/126-lan08:14:000
26038991514,1cyclictest65850irq/126-lan08:00:200
26038991514,1cyclictest65850irq/126-lan07:40:140
26038991414,0cyclictest65850irq/126-lan11:05:170
26038991414,0cyclictest65850irq/126-lan10:16:390
26038991414,0cyclictest65850irq/126-lan09:45:160
26038991414,0cyclictest65850irq/126-lan09:15:120
26038991414,0cyclictest65850irq/126-lan07:17:000
26038991413,1cyclictest65850irq/126-lan11:35:220
26038991413,1cyclictest65850irq/126-lan11:15:150
26038991413,1cyclictest65850irq/126-lan10:25:010
26038991413,1cyclictest65850irq/126-lan10:25:010
26038991413,1cyclictest65850irq/126-lan09:40:130
26038991413,1cyclictest65850irq/126-lan08:25:170
26038991413,1cyclictest65850irq/126-lan07:45:170
26038991413,1cyclictest65850irq/126-lan07:10:000
26038991312,1cyclictest65850irq/126-lan12:15:130
26038991312,1cyclictest65850irq/126-lan08:55:160
26038991312,1cyclictest65850irq/126-lan08:50:190
26038991212,0cyclictest65850irq/126-lan09:30:190
26038991211,1cyclictest65850irq/126-lan12:10:170
26038991211,1cyclictest65850irq/126-lan09:20:160
26038991110,1cyclictest65850irq/126-lan08:40:120
26038991010,0cyclictest65850irq/126-lan08:15:240
260519998,1cyclictest743-21snmpd12:22:053
260439998,1cyclictest743-21snmpd10:11:361
260439998,1cyclictest743-21snmpd07:44:521
260389999,0cyclictest65850irq/126-lan10:06:390
260389998,1cyclictest65850irq/126-lan11:30:140
260389998,1cyclictest65850irq/126-lan10:50:130
260519988,0cyclictest743-21snmpd10:25:223
260519988,0cyclictest743-21snmpd10:25:223
260519988,0cyclictest743-21snmpd07:58:493
260519988,0cyclictest741-21lldpd08:45:043
260519988,0cyclictest741-21lldpd07:24:223
260519987,1cyclictest743-21snmpd11:56:373
260519987,1cyclictest743-21snmpd08:40:023
260519987,1cyclictest743-21snmpd07:31:243
260519987,1cyclictest522-21avahi-daemon10:45:183
260519986,2cyclictest743-21snmpd08:32:203
260519986,2cyclictest743-21snmpd08:23:143
260519986,2cyclictest743-21snmpd07:16:243
260519986,2cyclictest743-21snmpd07:12:333
260469988,0cyclictest743-21snmpd09:16:312
260469988,0cyclictest743-21snmpd09:06:402
260469988,0cyclictest743-21snmpd07:33:252
260469988,0cyclictest741-21lldpd12:36:252
260469988,0cyclictest741-21lldpd09:32:402
260469988,0cyclictest741-21lldpd08:17:532
260469988,0cyclictest741-21lldpd07:39:492
260469987,1cyclictest743-21snmpd12:31:052
260469987,1cyclictest522-21avahi-daemon11:58:272
260469986,2cyclictest743-21snmpd07:54:282
260469986,2cyclictest743-21snmpd07:10:542
260439988,0cyclictest743-21snmpd12:03:041
260439988,0cyclictest743-21snmpd10:47:131
260439988,0cyclictest743-21snmpd08:32:441
260439988,0cyclictest741-21lldpd12:27:011
260439988,0cyclictest741-21lldpd11:12:081
260439988,0cyclictest741-21lldpd08:51:421
260439988,0cyclictest741-21lldpd08:49:141
260439987,1cyclictest743-21snmpd11:23:211
260439987,1cyclictest743-21snmpd09:26:041
260439987,1cyclictest743-21snmpd09:21:011
260439987,1cyclictest743-21snmpd09:12:461
260439987,1cyclictest743-21snmpd08:43:361
260439987,1cyclictest743-21snmpd08:00:491
260439987,1cyclictest741-21lldpd08:08:031
260439986,2cyclictest743-21snmpd12:05:131
260439986,2cyclictest743-21snmpd11:03:441
260439986,2cyclictest743-21snmpd09:51:291
260439986,2cyclictest743-21snmpd09:42:531
260439986,2cyclictest743-21snmpd08:36:421
260389988,0cyclictest65850irq/126-lan07:30:150
260389988,0cyclictest65850irq/126-lan07:13:580
260519977,0cyclictest743-21snmpd12:39:563
260519977,0cyclictest743-21snmpd11:11:143
260519977,0cyclictest743-21snmpd10:50:383
260519977,0cyclictest743-21snmpd09:45:473
260519977,0cyclictest741-21lldpd09:36:023
260519977,0cyclictest741-21lldpd09:06:503
260519977,0cyclictest741-21lldpd07:37:383
260519977,0cyclictest522-21avahi-daemon11:03:493
260519976,1cyclictest743-21snmpd12:00:313
260519976,1cyclictest741-21lldpd11:24:143
260519976,1cyclictest741-21lldpd10:35:533
260519975,2cyclictest743-21snmpd12:34:533
260519975,2cyclictest743-21snmpd11:41:393
260519975,2cyclictest743-21snmpd11:15:443
260519975,2cyclictest743-21snmpd10:34:403
260519975,2cyclictest743-21snmpd08:56:053
260469977,0cyclictest743-21snmpd10:19:482
260469977,0cyclictest743-21snmpd08:35:392
260469977,0cyclictest741-21lldpd11:41:242
260469976,1cyclictest743-21snmpd10:06:212
260469976,1cyclictest743-21snmpd07:19:482
260469976,1cyclictest741-21lldpd09:11:262
260469976,1cyclictest27533-21cron09:50:002
260469975,2cyclictest743-21snmpd12:13:522
260469975,2cyclictest743-21snmpd11:38:242
260469975,2cyclictest743-21snmpd10:55:022
260469975,2cyclictest743-21snmpd08:56:002
260469975,2cyclictest743-21snmpd07:23:472
260469973,3cyclictest13254-21ntp_states10:30:182
260439977,0cyclictest743-21snmpd07:10:031
260439977,0cyclictest741-21lldpd11:08:061
260439977,0cyclictest741-21lldpd07:55:281
260439976,1cyclictest743-21snmpd09:39:561
260439975,2cyclictest743-21snmpd12:10:491
260439975,2cyclictest743-21snmpd10:40:041
260439974,3cyclictest15143-21ld10:35:171
260439973,3cyclictest30858-21sed12:35:001
260439972,5cyclictest557-21NetworkManager11:17:211
260519966,0cyclictest741-21lldpd09:42:353
260519966,0cyclictest741-21lldpd08:19:013
260519966,0cyclictest741-21lldpd08:13:153
260519966,0cyclictest741-21lldpd08:05:253
260519965,1cyclictest8942-21cpuspeed_turbos07:45:153
260519965,1cyclictest743-21snmpd10:06:093
260519965,1cyclictest741-21lldpd08:02:513
260519965,1cyclictest26823-21fschecks_time11:05:133
260519964,2cyclictest743-21snmpd07:53:283
260519964,2cyclictest511ktimers/308:35:093
260519963,2cyclictest3035-21ntpq11:25:183
260519962,3cyclictest432-21needreboot10:00:133
260519962,3cyclictest244-20systemd-journal11:39:553
260519962,3cyclictest244-20systemd-journal07:40:483
260519962,3cyclictest13034-21ntp_192.168.11411:50:163
260469966,0cyclictest743-21snmpd08:03:412
260469966,0cyclictest741-21lldpd10:35:092
260469966,0cyclictest741-21lldpd09:01:102
260469966,0cyclictest741-21lldpd07:47:372
260469966,0cyclictest741-21lldpd07:40:132
260469966,0cyclictest522-21avahi-daemon08:21:402
260469965,1cyclictest743-21snmpd11:22:572
260469965,1cyclictest743-21snmpd10:50:052
260469965,1cyclictest743-21snmpd09:50:172
260469965,1cyclictest741-21lldpd10:22:232
260469965,1cyclictest741-21lldpd10:22:232
260469965,1cyclictest522-21avahi-daemon09:20:132
260469964,2cyclictest743-21snmpd12:07:342
260469964,2cyclictest743-21snmpd08:06:082
260469964,1cyclictest29438-21ntpq11:10:192
260469963,2cyclictest244-20systemd-journal11:50:152
260469962,3cyclictest2399-21df11:25:122
260469962,3cyclictest23456-21sensors_temp12:15:212
260439965,1cyclictest743-21snmpd12:18:201
260439965,1cyclictest743-21snmpd11:32:481
260439965,1cyclictest743-21snmpd10:08:331
260439965,1cyclictest743-21snmpd08:12:131
260439965,1cyclictest743-21snmpd07:45:101
260439965,1cyclictest21664-21fschecks_time08:15:181
260439964,2cyclictest743-21snmpd08:25:191
260439964,2cyclictest743-21snmpd07:38:551
260439963,3cyclictest743-21snmpd11:29:031
260439963,3cyclictest6515-21df_inode10:15:131
260439963,2cyclictest5557-21smartctl08:55:161
260439962,3cyclictest28945-21fw_forwarded_lo07:15:141
260439961,5cyclictest557-21NetworkManager10:51:161
260439960,5cyclictest3041-21ntpq07:30:191
260389966,0cyclictest65850irq/126-lan10:45:180
260519955,0cyclictest743-21snmpd12:27:083
260519955,0cyclictest741-21lldpd09:25:263
260519954,1cyclictest7535-21gltestperf09:00:143
260519954,1cyclictest743-21snmpd09:16:283
260519954,1cyclictest557-21NetworkManager08:50:223
260519954,1cyclictest522-21avahi-daemon10:40:143
260519952,3cyclictest557-21NetworkManager10:12:023
260519952,2cyclictest4268-21grep11:30:123
260519952,2cyclictest30575-21ld09:55:163
260519952,2cyclictest23803-21sshd12:15:393
260519952,2cyclictest23236-21ntpq10:55:163
260519952,2cyclictest16564-21unixbench_multi09:20:213
260519952,2cyclictest11636-21grep11:45:233
260519951,3cyclictest18557-21diskstats12:05:113
260519951,3cyclictest12549-21sed09:10:233
260469955,0cyclictest743-21snmpd12:00:102
260469955,0cyclictest741-21lldpd12:20:172
260469955,0cyclictest741-21lldpd09:41:072
260469955,0cyclictest506-21systemd-resolve08:33:272
260469954,1cyclictest506-21systemd-resolve08:51:252
260469954,1cyclictest19454-21cpuspeed_turbos08:10:102
260469954,1cyclictest18315-21kworker/2:1-mm_percpu_wq09:38:412
260469953,2cyclictest743-21snmpd11:46:462
260469953,2cyclictest743-21snmpd10:40:132
260469952,3cyclictest717-21ntpd10:00:012
260469952,3cyclictest557-21NetworkManager08:48:412
260469952,3cyclictest557-21NetworkManager08:28:132
260469952,2cyclictest575-21rs:main2
260469952,2cyclictest575-21rs:main2
260469952,2cyclictest5635-21seq11:30:292
260469952,2cyclictest28253-21awk12:25:232
260469952,2cyclictest18529-21sed09:25:232
260469951,3cyclictest31737-21sed11:15:232
260469951,3cyclictest27130-21sed11:05:152
260469951,3cyclictest25321-21sed11:00:162
260469951,3cyclictest244-20systemd-journal09:55:342
260439954,1cyclictest743-21snmpd12:20:141
260439954,1cyclictest743-21snmpd11:44:511
260439954,1cyclictest31879-21wc12:35:171
260439954,1cyclictest13168-21ntp_states11:50:181
260439954,1cyclictest10607-21fschecks_count10:25:111
260439954,1cyclictest10607-21fschecks_count10:25:111
260439953,2cyclictest743-21snmpd10:58:111
260439953,2cyclictest743-21snmpd10:34:191
260439953,2cyclictest743-21snmpd09:45:291
260439953,2cyclictest743-21snmpd09:15:041
260439953,2cyclictest30603-21ld09:55:161
260439953,2cyclictest20914-21sed09:30:221
260439953,2cyclictest14774-21cat11:55:161
260439952,3cyclictest32070-21gpg-connect-age10:00:001
260439952,2cyclictest9219-21ldconfig10:20:171
260439952,2cyclictest9219-21ldconfig10:20:171
260439952,2cyclictest31694-21grep07:20:191
260439951,3cyclictest10046-21ntpq09:05:161
260439950,4cyclictest934-21tail07:25:151
260519943,1cyclictest511ktimers/312:10:153
260519942,2cyclictest743-21snmpd10:20:093
260519942,2cyclictest743-21snmpd10:20:093
260519942,2cyclictest32701-21apt-get07:25:123
260519941,2cyclictest575-21rs:main3
260519940,4cyclictest26174-21ntpq08:25:163
260519940,3cyclictest6647-21fw_forwarded_lo10:15:143
260519940,3cyclictest19897-21diskstats09:30:133
260469941,2cyclictest941-21grep07:25:152
260469941,2cyclictest4572-21grep10:10:152
260469941,2cyclictest31864-21sed08:40:122
260469940,3cyclictest10570-21diskstats10:25:102
260469940,3cyclictest10570-21diskstats10:25:092
260439943,1cyclictest0-21swapper/111:35:131
260439942,2cyclictest23581-21grep08:20:161
260439941,2cyclictest717-21ntpd07:50:221
260439940,4cyclictest7949-21ntpq09:00:171
260439940,3cyclictest10493-21diskstats11:45:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional